Apr 13 15:03:09 user nova-compute[71507]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 13 15:03:12 user nova-compute[71507]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71507) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71507) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71507) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 15:03:12 user nova-compute[71507]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:03:12 user nova-compute[71507]: INFO nova.virt.driver [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 13 15:03:12 user nova-compute[71507]: INFO nova.compute.provider_config [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] Acquiring lock "singleton_lock" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] Acquired lock "singleton_lock" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] Releasing lock "singleton_lock" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] Full set of CONF: {{(pid=71507) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ******************************************************************************** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] Configuration options gathered from: {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ================================================================================ {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] allow_resize_to_same_host      = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] arq_binding_timeout            = 300 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] backdoor_port                  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] backdoor_socket                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] block_device_allocate_retries  = 300 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] block_device_allocate_retries_interval = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cert                           = self.pem {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute_monitors               = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] config_dir                     = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] config_drive_format            = iso9660 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] config_source                  = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] console_host                   = user {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] control_exchange               = nova {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cpu_allocation_ratio           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] daemon                         = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] debug                          = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] default_access_ip_network_name = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] default_availability_zone      = nova {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] default_ephemeral_format       = ext4 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] default_schedule_zone          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] disk_allocation_ratio          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] enable_new_services            = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] enabled_apis                   = ['osapi_compute'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] enabled_ssl_apis               = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] flat_injected                  = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] force_config_drive             = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] force_raw_images               = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] graceful_shutdown_timeout      = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] heal_instance_info_cache_interval = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] host                           = user {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] instance_build_timeout         = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] instance_delete_interval       = 300 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] instance_format                = [instance: %(uuid)s]  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] instance_name_template         = instance-%08x {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] instance_usage_audit           = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] instance_usage_audit_period    = month {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] internal_service_availability_zone = internal {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] key                            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] live_migration_retry_count     = 30 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] log_config_append              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] log_dir                        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] log_file                       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] log_options                    = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] log_rotate_interval            = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] log_rotate_interval_type       = days {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] log_rotation_type              = none {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] long_rpc_timeout               = 1800 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] max_concurrent_builds          = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] max_concurrent_live_migrations = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] max_concurrent_snapshots       = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] max_local_block_devices        = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] max_logfile_count              = 30 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] max_logfile_size_mb            = 200 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] maximum_instance_delete_attempts = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] metadata_listen                = 0.0.0.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] metadata_listen_port           = 8775 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] metadata_workers               = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] migrate_max_retries            = -1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] mkisofs_cmd                    = genisoimage {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] my_ip                          = 10.0.0.210 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] network_allocate_retries       = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] osapi_compute_listen_port      = 8774 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] osapi_compute_unique_server_name_scope =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] osapi_compute_workers          = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] password_length                = 12 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] periodic_enable                = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] periodic_fuzzy_delay           = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] pointer_model                  = ps2mouse {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] preallocate_images             = none {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] publish_errors                 = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] pybasedir                      = /opt/stack/nova {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ram_allocation_ratio           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] rate_limit_burst               = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] rate_limit_except_level        = CRITICAL {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] rate_limit_interval            = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] reboot_timeout                 = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] reclaim_instance_interval      = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] record                         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] reimage_timeout_per_gb         = 20 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] report_interval                = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] rescue_timeout                 = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] reserved_host_cpus             = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] reserved_host_disk_mb          = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] reserved_host_memory_mb        = 512 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] reserved_huge_pages            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] resize_confirm_window          = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] resize_fs_using_block_device   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] resume_guests_state_on_host_boot = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] rpc_response_timeout           = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] run_external_periodic_tasks    = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] running_deleted_instance_action = reap {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] running_deleted_instance_poll_interval = 1800 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] running_deleted_instance_timeout = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler_instance_sync_interval = 120 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_down_time              = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] servicegroup_driver            = db {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] shelved_offload_time           = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] shelved_poll_interval          = 3600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] shutdown_timeout               = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] source_is_ipv6                 = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ssl_only                       = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] state_path                     = /opt/stack/data/nova {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] sync_power_state_interval      = 600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] sync_power_state_pool_size     = 1000 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] syslog_log_facility            = LOG_USER {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] tempdir                        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] timeout_nbd                    = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] transport_url                  = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] update_resources_interval      = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] use_cow_images                 = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] use_eventlog                   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] use_journal                    = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] use_json                       = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] use_rootwrap_daemon            = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] use_stderr                     = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] use_syslog                     = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vcpu_pin_set                   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plugging_is_fatal          = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plugging_timeout           = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] virt_mkfs                      = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] volume_usage_poll_interval     = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] watch_log_file                 = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] web                            = /usr/share/spice-html5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_concurrency.disable_process_locking = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.auth_strategy              = keystone {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.compute_link_prefix        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.dhcp_domain                = novalocal {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.enable_instance_password   = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.glance_link_prefix         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.instance_list_per_project_cells = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.list_records_by_skipping_down_cells = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.local_metadata_per_cell    = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.max_limit                  = 1000 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.metadata_cache_expiration  = 15 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.neutron_default_tenant_id  = default {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.use_forwarded_for          = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.use_neutron_default_nets   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.vendordata_dynamic_targets = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.vendordata_jsonfile_path   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.backend                  = dogpile.cache.memcached {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.backend_argument         = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.config_prefix            = cache.oslo {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.dead_timeout             = 60.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.debug_cache_backend      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.enable_retry_client      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.enable_socket_keepalive  = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.enabled                  = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.expiration_time          = 600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.hashclient_retry_attempts = 2 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_dead_retry      = 300 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_password        =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_pool_maxsize    = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_sasl_enabled    = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.memcache_username        =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.proxies                  = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.retry_attempts           = 2 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.retry_delay              = 0.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.socket_keepalive_count   = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.socket_keepalive_idle    = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.socket_keepalive_interval = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.tls_allowed_ciphers      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.tls_cafile               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.tls_certfile             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.tls_enabled              = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cache.tls_keyfile              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.auth_section            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.auth_type               = password {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.cafile                  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.certfile                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.collect_timing          = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.cross_az_attach         = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.debug                   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.endpoint_template       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.http_retries            = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.insecure                = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.keyfile                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.os_region_name          = RegionOne {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.split_loggers           = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cinder.timeout                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.cpu_dedicated_set      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.cpu_shared_set         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.image_type_exclude_list = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.max_concurrent_disk_ops = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.max_disk_devices_to_attach = -1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.resource_provider_association_refresh = 300 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.shutdown_retry_interval = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] conductor.workers              = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] console.allowed_origins        = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] console.ssl_ciphers            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] console.ssl_minimum_version    = default {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] consoleauth.token_ttl          = 600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.cafile                  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.certfile                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.collect_timing          = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.connect_retries         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.connect_retry_delay     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.endpoint_override       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.insecure                = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.keyfile                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.max_version             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.min_version             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.region_name             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.service_name            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.service_type            = accelerator {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.split_loggers           = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.status_code_retries     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.status_code_retry_delay = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.timeout                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] cyborg.version                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.backend               = sqlalchemy {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.connection            = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.connection_debug      = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.connection_parameters =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.connection_recycle_time = 3600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.connection_trace      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.db_inc_retry_interval = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.db_max_retries        = 20 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.db_max_retry_interval = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.db_retry_interval     = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.max_overflow          = 50 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.max_pool_size         = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.max_retries           = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.mysql_enable_ndb      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.mysql_wsrep_sync_wait = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.pool_timeout          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.retry_interval        = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.slave_connection      = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] database.sqlite_synchronous    = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.backend           = sqlalchemy {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.connection        = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.connection_debug  = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.connection_parameters =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.connection_recycle_time = 3600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.connection_trace  = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.db_inc_retry_interval = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.db_max_retries    = 20 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.db_max_retry_interval = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.db_retry_interval = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.max_overflow      = 50 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.max_pool_size     = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.max_retries       = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.mysql_enable_ndb  = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.pool_timeout      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.retry_interval    = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.slave_connection  = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] api_database.sqlite_synchronous = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] devices.enabled_mdev_types     = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ephemeral_storage_encryption.enabled = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.api_servers             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.cafile                  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.certfile                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.collect_timing          = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.connect_retries         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.connect_retry_delay     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.debug                   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.default_trusted_certificate_ids = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.enable_certificate_validation = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.enable_rbd_download     = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.endpoint_override       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.insecure                = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.keyfile                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:12 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.max_version             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.min_version             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.num_retries             = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.rbd_ceph_conf           =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.rbd_connect_timeout     = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.rbd_pool                =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.rbd_user                =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.region_name             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.service_name            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.service_type            = image {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.split_loggers           = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.status_code_retries     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.status_code_retry_delay = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.timeout                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.verify_glance_signatures = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] glance.version                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] guestfs.debug                  = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.config_drive_cdrom      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.config_drive_inject_password = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.enable_instance_metrics_collection = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.enable_remotefx         = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.instances_path_share    =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.iscsi_initiator_list    = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.limit_cpu_features      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.power_state_check_timeframe = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.use_multipath_io        = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.volume_attach_retry_count = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.vswitch_name            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] mks.enabled                    = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] image_cache.manager_interval   = 2400 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] image_cache.precache_concurrency = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] image_cache.remove_unused_base_images = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] image_cache.subdirectory_name  = _base {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.api_max_retries         = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.api_retry_interval      = 2 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.auth_section            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.auth_type               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.cafile                  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.certfile                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.collect_timing          = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.connect_retries         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.connect_retry_delay     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.endpoint_override       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.insecure                = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.keyfile                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.max_version             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.min_version             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.partition_key           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.peer_list               = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.region_name             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.serial_console_state_timeout = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.service_name            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.service_type            = baremetal {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.split_loggers           = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.status_code_retries     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.status_code_retry_delay = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.timeout                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ironic.version                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] key_manager.fixed_key          = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.barbican_api_version  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.barbican_endpoint     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.barbican_endpoint_type = public {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.barbican_region_name  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.cafile                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.certfile              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.collect_timing        = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.insecure              = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.keyfile               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.number_of_retries     = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.retry_delay           = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.send_service_user_token = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.split_loggers         = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.timeout               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.verify_ssl            = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican.verify_ssl_path       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican_service_user.auth_section = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican_service_user.auth_type = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican_service_user.cafile   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican_service_user.certfile = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican_service_user.collect_timing = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican_service_user.insecure = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican_service_user.keyfile  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican_service_user.split_loggers = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] barbican_service_user.timeout  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.approle_role_id          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.approle_secret_id        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.cafile                   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.certfile                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.collect_timing           = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.insecure                 = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.keyfile                  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.kv_mountpoint            = secret {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.kv_version               = 2 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.namespace                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.root_token_id            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.split_loggers            = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.ssl_ca_crt_file          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.timeout                  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.use_ssl                  = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.cafile                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.certfile              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.collect_timing        = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.connect_retries       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.connect_retry_delay   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.endpoint_override     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.insecure              = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.keyfile               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.max_version           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.min_version           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.region_name           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.service_name          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.service_type          = identity {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.split_loggers         = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.status_code_retries   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.status_code_retry_delay = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.timeout               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] keystone.version               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.connection_uri         =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.cpu_mode               = custom {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: WARNING oslo_config.cfg [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.cpu_power_governor_high = performance {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.cpu_power_governor_low = powersave {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.cpu_power_management   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.device_detach_attempts = 8 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.device_detach_timeout  = 20 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.disk_cachemodes        = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.disk_prefix            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.enabled_perf_events    = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.file_backed_memory     = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.gid_maps               = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.hw_disk_discard        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.hw_machine_type        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.images_rbd_glance_store_name =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.images_rbd_pool        = rbd {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.images_type            = default {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.images_volume_group    = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.inject_key             = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.inject_partition       = -2 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.inject_password        = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.iscsi_iface            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.iser_use_multipath     = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_bandwidth = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_downtime = 500 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_inbound_addr = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_permit_post_copy = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_scheme  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_timeout_action = abort {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_tunnelled = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: WARNING oslo_config.cfg [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 13 15:03:13 user nova-compute[71507]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 13 15:03:13 user nova-compute[71507]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 13 15:03:13 user nova-compute[71507]: and ``live_migration_inbound_addr`` respectively.
Apr 13 15:03:13 user nova-compute[71507]: ).  Its value may be silently ignored in the future.
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.live_migration_with_native_tls = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.max_queues             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.nfs_mount_options      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.num_memory_encrypted_guests = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.num_pcie_ports         = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.pmem_namespaces        = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.quobyte_client_cfg     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rbd_secret_uuid        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rbd_user               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.remote_filesystem_transport = ssh {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rescue_image_id        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rescue_kernel_id       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rescue_ramdisk_id      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.rx_queue_size          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.smbfs_mount_options    =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.snapshot_compression   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.snapshot_image_format  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.sparse_logical_volumes = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.swtpm_enabled          = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.swtpm_group            = tss {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.swtpm_user             = tss {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.sysinfo_serial         = unique {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.tx_queue_size          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.uid_maps               = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.use_virtio_for_bridges = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.virt_type              = kvm {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.volume_clear           = zero {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.volume_clear_size      = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.volume_use_multipath   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.vzstorage_cache_path   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.vzstorage_mount_user   = stack {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.auth_section           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.auth_type              = password {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.cafile                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.certfile               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.collect_timing         = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.connect_retries        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.connect_retry_delay    = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.default_floating_pool  = public {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.endpoint_override      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.extension_sync_interval = 600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.http_retries           = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.insecure               = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.keyfile                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.max_version            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.min_version            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.ovs_bridge             = br-int {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.physnets               = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.region_name            = RegionOne {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.service_metadata_proxy = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.service_name           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.service_type           = network {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.split_loggers          = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.status_code_retries    = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.status_code_retry_delay = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.timeout                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] neutron.version                = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] notifications.bdms_in_notifications = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] notifications.default_level    = INFO {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] notifications.notification_format = unversioned {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] notifications.notify_on_state_change = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] pci.alias                      = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] pci.device_spec                = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] pci.report_in_placement        = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.auth_section         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.auth_type            = password {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.cafile               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.certfile             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.collect_timing       = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.connect_retries      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.connect_retry_delay  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.default_domain_id    = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.default_domain_name  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.domain_id            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.domain_name          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.endpoint_override    = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.insecure             = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.keyfile              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.max_version          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.min_version          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.password             = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.project_domain_id    = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.project_domain_name  = Default {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.project_id           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.project_name         = service {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.region_name          = RegionOne {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.service_name         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.service_type         = placement {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.split_loggers        = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.status_code_retries  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.status_code_retry_delay = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.system_scope         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.timeout              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.trust_id             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.user_domain_id       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.user_domain_name     = Default {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.user_id              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.username             = placement {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] placement.version              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.cores                    = 20 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.count_usage_from_placement = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.injected_file_content_bytes = 10240 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.injected_file_path_length = 255 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.injected_files           = 5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.instances                = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.key_pairs                = 100 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.metadata_items           = 128 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.ram                      = 51200 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.recheck_quota            = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.server_group_members     = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] quota.server_groups            = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] rdp.enabled                    = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.image_metadata_prefilter = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.max_attempts         = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.max_placement_results = 1000 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.query_placement_for_availability_zone = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.query_placement_for_image_type_support = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] scheduler.workers              = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.host_subset_size = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.isolated_hosts = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.isolated_images = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.pci_in_placement = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.track_instance_changes = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] metrics.required               = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] metrics.weight_multiplier      = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] metrics.weight_setting         = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] serial_console.enabled         = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] serial_console.port_range      = 10000:20000 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] serial_console.serialproxy_port = 6083 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.auth_section      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.auth_type         = password {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.cafile            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.certfile          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.collect_timing    = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.insecure          = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.keyfile           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.send_service_user_token = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.split_loggers     = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] service_user.timeout           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.agent_enabled            = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.enabled                  = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.html5proxy_port          = 6082 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.image_compression        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.jpeg_compression         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.playback_compression     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.server_listen            = 127.0.0.1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.streaming_mode           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] spice.zlib_compression         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] upgrade_levels.baseapi         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] upgrade_levels.cert            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] upgrade_levels.compute         = auto {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] upgrade_levels.conductor       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] upgrade_levels.scheduler       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vendordata_dynamic_auth.auth_section = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vendordata_dynamic_auth.auth_type = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vendordata_dynamic_auth.cafile = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vendordata_dynamic_auth.certfile = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vendordata_dynamic_auth.insecure = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vendordata_dynamic_auth.keyfile = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vendordata_dynamic_auth.timeout = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.api_retry_count         = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.ca_file                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.cache_prefix            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.cluster_name            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.connection_pool_size    = 10 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.console_delay_seconds   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.datastore_regex         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.host_ip                 = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.host_password           = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.host_port               = 443 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.host_username           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.insecure                = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.integration_bridge      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.maximum_objects         = 100 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.pbm_default_policy      = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.pbm_enabled             = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.pbm_wsdl_location       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.serial_port_proxy_uri   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.serial_port_service_uri = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.task_poll_interval      = 0.5 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.use_linked_clone        = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.vnc_keymap              = en-us {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.vnc_port                = 5900 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vmware.vnc_port_total          = 10000 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.auth_schemes               = ['none'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.enabled                    = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.novncproxy_port            = 6080 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.server_listen              = 0.0.0.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.vencrypt_ca_certs          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.vencrypt_client_cert       = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vnc.vencrypt_client_key        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.disable_rootwrap   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.enable_numa_live_migration = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.libvirt_disable_apic = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.client_socket_timeout     = 900 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.default_pool_size         = 1000 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.keep_alive                = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.max_header_line           = 16384 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.ssl_ca_file               = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.ssl_cert_file             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.ssl_key_file              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.tcp_keepidle              = 600 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] zvm.ca_file                    = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] zvm.cloud_connector_url        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] zvm.reachable_timeout          = 300 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.enforce_new_defaults = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.enforce_scope      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.policy_default_rule = default {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.policy_file        = policy.yaml {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.connection_string     = messaging:// {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.enabled               = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.es_doc_type           = notification {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.es_scroll_size        = 10000 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.es_scroll_time        = 2m {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.filter_error_trace    = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.sentinel_service_name = mymaster {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.socket_timeout        = 0.1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] profiler.trace_sqlalchemy      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] remote_debug.host              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] remote_debug.port              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.ssl      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_notifications.retry = -1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_messaging_notifications.transport_url = **** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.auth_section        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.auth_type           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.cafile              = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.certfile            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.collect_timing      = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.connect_retries     = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.connect_retry_delay = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.endpoint_id         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.endpoint_override   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.insecure            = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.keyfile             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.max_version         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.min_version         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.region_name         = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.service_name        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.service_type        = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.split_loggers       = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.status_code_retries = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.status_code_retry_delay = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.timeout             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.valid_interfaces    = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_limit.version             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_reports.file_event_handler = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] oslo_reports.log_dir           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_ovs_privileged.group  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] vif_plug_ovs_privileged.user   = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_linux_bridge.flat_interface = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_ovs.isolate_vif         = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_vif_ovs.per_port_bridge     = False {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] os_brick.lock_path             = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] privsep_osbrick.capabilities   = [21] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] privsep_osbrick.group          = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] privsep_osbrick.helper_command = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] privsep_osbrick.user           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] nova_sys_admin.group           = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] nova_sys_admin.helper_command  = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] nova_sys_admin.user            = None {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG oslo_service.service [None req-9669ebb1-729f-44bd-8878-8e0c94a49acf None None] ******************************************************************************** {{(pid=71507) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 13 15:03:13 user nova-compute[71507]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 13 15:03:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Starting native event thread {{(pid=71507) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Starting green dispatch thread {{(pid=71507) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Starting connection event dispatch thread {{(pid=71507) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Connecting to libvirt: qemu:///system {{(pid=71507) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fab249c2620> {{(pid=71507) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 13 15:03:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fab249c2620> {{(pid=71507) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 13 15:03:13 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Connection event '1' reason 'None'
Apr 13 15:03:13 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 15:03:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.mount [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Initialising _HostMountState generation 0 {{(pid=71507) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 13 15:03:20 user nova-compute[71507]: INFO nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt host capabilities <capabilities>
Apr 13 15:03:20 user nova-compute[71507]:   <host>
Apr 13 15:03:20 user nova-compute[71507]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 13 15:03:20 user nova-compute[71507]:     <cpu>
Apr 13 15:03:20 user nova-compute[71507]:       <arch>x86_64</arch>
Apr 13 15:03:20 user nova-compute[71507]:       <model>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <vendor>Intel</vendor>
Apr 13 15:03:20 user nova-compute[71507]:       <microcode version='1070'/>
Apr 13 15:03:20 user nova-compute[71507]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 13 15:03:20 user nova-compute[71507]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='ss'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='vmx'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='pcid'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='osxsave'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='hypervisor'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='arat'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='tsc_adjust'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='md-clear'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='arch-capabilities'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='invtsc'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='rsba'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature name='skip-l1dfl-vmentry'/>
Apr 13 15:03:20 user nova-compute[71507]:       <pages unit='KiB' size='4'/>
Apr 13 15:03:20 user nova-compute[71507]:       <pages unit='KiB' size='2048'/>
Apr 13 15:03:20 user nova-compute[71507]:     </cpu>
Apr 13 15:03:20 user nova-compute[71507]:     <power_management>
Apr 13 15:03:20 user nova-compute[71507]:       <suspend_mem/>
Apr 13 15:03:20 user nova-compute[71507]:       <suspend_disk/>
Apr 13 15:03:20 user nova-compute[71507]:       <suspend_hybrid/>
Apr 13 15:03:20 user nova-compute[71507]:     </power_management>
Apr 13 15:03:20 user nova-compute[71507]:     <iommu support='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     <migration_features>
Apr 13 15:03:20 user nova-compute[71507]:       <live/>
Apr 13 15:03:20 user nova-compute[71507]:       <uri_transports>
Apr 13 15:03:20 user nova-compute[71507]:         <uri_transport>tcp</uri_transport>
Apr 13 15:03:20 user nova-compute[71507]:         <uri_transport>rdma</uri_transport>
Apr 13 15:03:20 user nova-compute[71507]:       </uri_transports>
Apr 13 15:03:20 user nova-compute[71507]:     </migration_features>
Apr 13 15:03:20 user nova-compute[71507]:     <topology>
Apr 13 15:03:20 user nova-compute[71507]:       <cells num='2'>
Apr 13 15:03:20 user nova-compute[71507]:         <cell id='0'>
Apr 13 15:03:20 user nova-compute[71507]:           <memory unit='KiB'>8152920</memory>
Apr 13 15:03:20 user nova-compute[71507]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 13 15:03:20 user nova-compute[71507]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 15:03:20 user nova-compute[71507]:           <distances>
Apr 13 15:03:20 user nova-compute[71507]:             <sibling id='0' value='10'/>
Apr 13 15:03:20 user nova-compute[71507]:             <sibling id='1' value='20'/>
Apr 13 15:03:20 user nova-compute[71507]:           </distances>
Apr 13 15:03:20 user nova-compute[71507]:           <cpus num='6'>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 13 15:03:20 user nova-compute[71507]:           </cpus>
Apr 13 15:03:20 user nova-compute[71507]:         </cell>
Apr 13 15:03:20 user nova-compute[71507]:         <cell id='1'>
Apr 13 15:03:20 user nova-compute[71507]:           <memory unit='KiB'>8255068</memory>
Apr 13 15:03:20 user nova-compute[71507]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 13 15:03:20 user nova-compute[71507]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 15:03:20 user nova-compute[71507]:           <distances>
Apr 13 15:03:20 user nova-compute[71507]:             <sibling id='0' value='20'/>
Apr 13 15:03:20 user nova-compute[71507]:             <sibling id='1' value='10'/>
Apr 13 15:03:20 user nova-compute[71507]:           </distances>
Apr 13 15:03:20 user nova-compute[71507]:           <cpus num='6'>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 13 15:03:20 user nova-compute[71507]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 13 15:03:20 user nova-compute[71507]:           </cpus>
Apr 13 15:03:20 user nova-compute[71507]:         </cell>
Apr 13 15:03:20 user nova-compute[71507]:       </cells>
Apr 13 15:03:20 user nova-compute[71507]:     </topology>
Apr 13 15:03:20 user nova-compute[71507]:     <cache>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 13 15:03:20 user nova-compute[71507]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 13 15:03:20 user nova-compute[71507]:     </cache>
Apr 13 15:03:20 user nova-compute[71507]:     <secmodel>
Apr 13 15:03:20 user nova-compute[71507]:       <model>apparmor</model>
Apr 13 15:03:20 user nova-compute[71507]:       <doi>0</doi>
Apr 13 15:03:20 user nova-compute[71507]:     </secmodel>
Apr 13 15:03:20 user nova-compute[71507]:     <secmodel>
Apr 13 15:03:20 user nova-compute[71507]:       <model>dac</model>
Apr 13 15:03:20 user nova-compute[71507]:       <doi>0</doi>
Apr 13 15:03:20 user nova-compute[71507]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 13 15:03:20 user nova-compute[71507]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 13 15:03:20 user nova-compute[71507]:     </secmodel>
Apr 13 15:03:20 user nova-compute[71507]:   </host>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='alpha'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>clipper</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='armv6l'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>spitz</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>nuri</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>kzm</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sx1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>z2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>tosa</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>n810</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>n800</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>terrier</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>midway</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>microbit</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>verdex</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>highbank</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>akita</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>connex</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>collie</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='armv7l'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>spitz</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>nuri</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>kzm</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sx1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>z2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>tosa</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>n810</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>n800</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>terrier</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>midway</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>microbit</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>verdex</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>highbank</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>akita</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>connex</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>collie</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='aarch64'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>spitz</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>nuri</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>kzm</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sx1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>z2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>tosa</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>n810</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>n800</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>terrier</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>midway</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>microbit</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>verdex</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>raspi3b</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>highbank</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>akita</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>connex</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>collie</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <acpi default='on' toggle='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='cris'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='i686'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>isapc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>microvm</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='kvm'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <pae/>
Apr 13 15:03:20 user nova-compute[71507]:       <nonpae/>
Apr 13 15:03:20 user nova-compute[71507]:       <acpi default='on' toggle='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:       <apic default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='m68k'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>an5206</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>q800</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>next-cube</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='microblaze'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='microblazeel'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='mips'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='16'>malta</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='mipsel'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='16'>malta</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='mips64'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='16'>malta</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>pica61</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>magnum</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='mips64el'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='16'>malta</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>pica61</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>magnum</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='16'>boston</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='ppc'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mac99</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>40p</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>taihu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='ppc64'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>taihu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>40p</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mac99</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='ppc64le'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>taihu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>40p</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>mac99</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='riscv32'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='8'>spike</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>opentitan</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='8'>virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='riscv64'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='8'>spike</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>shakti_c</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='8'>virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='s390x'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='sh4'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>shix</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>r2d</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='sh4eb'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>shix</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>r2d</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='sparc'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>SS-5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>SS-20</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>LX</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>SS-4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>SS-10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>Voyager</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='sparc64'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sun4u</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>niagara</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>sun4v</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='x86_64'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>64</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='1'>isapc</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>microvm</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='kvm'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <acpi default='on' toggle='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:       <apic default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='xtensa'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>sim</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>kc705</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>ml605</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>lx200</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>lx60</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]:   <guest>
Apr 13 15:03:20 user nova-compute[71507]:     <os_type>hvm</os_type>
Apr 13 15:03:20 user nova-compute[71507]:     <arch name='xtensaeb'>
Apr 13 15:03:20 user nova-compute[71507]:       <wordsize>32</wordsize>
Apr 13 15:03:20 user nova-compute[71507]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='4'>sim</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>kc705</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>ml605</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>virt</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>lx200</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>lx60</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 15:03:20 user nova-compute[71507]:       <domain type='qemu'/>
Apr 13 15:03:20 user nova-compute[71507]:     </arch>
Apr 13 15:03:20 user nova-compute[71507]:     <features>
Apr 13 15:03:20 user nova-compute[71507]:       <cpuselection/>
Apr 13 15:03:20 user nova-compute[71507]:       <deviceboot/>
Apr 13 15:03:20 user nova-compute[71507]:       <disksnapshot default='on' toggle='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     </features>
Apr 13 15:03:20 user nova-compute[71507]:   </guest>
Apr 13 15:03:20 user nova-compute[71507]: </capabilities>
Apr 13 15:03:20 user nova-compute[71507]: 
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 13 15:03:20 user nova-compute[71507]: <domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 15:03:20 user nova-compute[71507]:   <domain>kvm</domain>
Apr 13 15:03:20 user nova-compute[71507]:   <machine>pc-i440fx-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:   <arch>i686</arch>
Apr 13 15:03:20 user nova-compute[71507]:   <vcpu max='255'/>
Apr 13 15:03:20 user nova-compute[71507]:   <iothreads supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:   <os supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='firmware'/>
Apr 13 15:03:20 user nova-compute[71507]:     <loader supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>rom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pflash</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='readonly'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='secure'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </loader>
Apr 13 15:03:20 user nova-compute[71507]:   </os>
Apr 13 15:03:20 user nova-compute[71507]:   <cpu>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-passthrough' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='hostPassthroughMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='maximum' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='maximumMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-model' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <vendor>Intel</vendor>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ss'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='vmx'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pcid'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='hypervisor'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arat'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='umip'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='md-clear'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibpb'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibrs'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='erms'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='lm'/>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='custom' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>qemu64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>qemu32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>phenom</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>n270</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>kvm64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>coreduo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>core2duo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>athlon</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Westmere</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Snowridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Penryn</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G5</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G4</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G1</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Nehalem</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Rome</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Milan</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Dhyana</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cooperlake</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Conroe</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>486</model>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:   </cpu>
Apr 13 15:03:20 user nova-compute[71507]:   <memoryBacking supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='sourceType'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>file</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>anonymous</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>memfd</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:   </memoryBacking>
Apr 13 15:03:20 user nova-compute[71507]:   <devices>
Apr 13 15:03:20 user nova-compute[71507]:     <disk supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='diskDevice'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>disk</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cdrom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>floppy</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>lun</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='bus'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ide</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>fdc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sata</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </disk>
Apr 13 15:03:20 user nova-compute[71507]:     <graphics supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sdl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vnc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>spice</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egl-headless</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </graphics>
Apr 13 15:03:20 user nova-compute[71507]:     <video supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='modelType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cirrus</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vmvga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>qxl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>none</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>bochs</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ramfb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </video>
Apr 13 15:03:20 user nova-compute[71507]:     <hostdev supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='mode'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>subsystem</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='startupPolicy'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>default</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>mandatory</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>requisite</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>optional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='subsysType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pci</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='capsType'/>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='pciBackend'/>
Apr 13 15:03:20 user nova-compute[71507]:     </hostdev>
Apr 13 15:03:20 user nova-compute[71507]:     <rng supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>random</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egd</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>builtin</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </rng>
Apr 13 15:03:20 user nova-compute[71507]:     <filesystem supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='driverType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>path</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>handle</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtiofs</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </filesystem>
Apr 13 15:03:20 user nova-compute[71507]:     <tpm supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-tis</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-crb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>passthrough</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>emulator</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </tpm>
Apr 13 15:03:20 user nova-compute[71507]:   </devices>
Apr 13 15:03:20 user nova-compute[71507]:   <features>
Apr 13 15:03:20 user nova-compute[71507]:     <gic supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     <vmcoreinfo supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <genid supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backingStoreInput supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backup supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <sev supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:   </features>
Apr 13 15:03:20 user nova-compute[71507]: </domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:  {{(pid=71507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 13 15:03:20 user nova-compute[71507]: <domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 15:03:20 user nova-compute[71507]:   <domain>kvm</domain>
Apr 13 15:03:20 user nova-compute[71507]:   <machine>pc-i440fx-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:   <arch>i686</arch>
Apr 13 15:03:20 user nova-compute[71507]:   <vcpu max='255'/>
Apr 13 15:03:20 user nova-compute[71507]:   <iothreads supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:   <os supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='firmware'/>
Apr 13 15:03:20 user nova-compute[71507]:     <loader supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>rom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pflash</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='readonly'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='secure'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </loader>
Apr 13 15:03:20 user nova-compute[71507]:   </os>
Apr 13 15:03:20 user nova-compute[71507]:   <cpu>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-passthrough' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='hostPassthroughMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='maximum' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='maximumMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-model' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <vendor>Intel</vendor>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ss'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='vmx'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pcid'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='hypervisor'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arat'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='umip'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='md-clear'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibpb'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibrs'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='erms'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='lm'/>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='custom' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>qemu64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>qemu32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>phenom</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>n270</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>kvm64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>coreduo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>core2duo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>athlon</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Westmere</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Snowridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Penryn</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G5</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G4</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G1</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Nehalem</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Rome</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Milan</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Dhyana</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cooperlake</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Conroe</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>486</model>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:   </cpu>
Apr 13 15:03:20 user nova-compute[71507]:   <memoryBacking supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='sourceType'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>file</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>anonymous</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>memfd</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:   </memoryBacking>
Apr 13 15:03:20 user nova-compute[71507]:   <devices>
Apr 13 15:03:20 user nova-compute[71507]:     <disk supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='diskDevice'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>disk</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cdrom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>floppy</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>lun</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='bus'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ide</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>fdc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sata</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </disk>
Apr 13 15:03:20 user nova-compute[71507]:     <graphics supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sdl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vnc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>spice</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egl-headless</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </graphics>
Apr 13 15:03:20 user nova-compute[71507]:     <video supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='modelType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cirrus</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vmvga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>qxl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>none</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>bochs</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ramfb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </video>
Apr 13 15:03:20 user nova-compute[71507]:     <hostdev supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='mode'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>subsystem</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='startupPolicy'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>default</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>mandatory</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>requisite</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>optional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='subsysType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pci</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='capsType'/>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='pciBackend'/>
Apr 13 15:03:20 user nova-compute[71507]:     </hostdev>
Apr 13 15:03:20 user nova-compute[71507]:     <rng supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>random</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egd</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>builtin</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </rng>
Apr 13 15:03:20 user nova-compute[71507]:     <filesystem supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='driverType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>path</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>handle</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtiofs</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </filesystem>
Apr 13 15:03:20 user nova-compute[71507]:     <tpm supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-tis</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-crb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>passthrough</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>emulator</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </tpm>
Apr 13 15:03:20 user nova-compute[71507]:   </devices>
Apr 13 15:03:20 user nova-compute[71507]:   <features>
Apr 13 15:03:20 user nova-compute[71507]:     <gic supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     <vmcoreinfo supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <genid supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backingStoreInput supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backup supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <sev supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:   </features>
Apr 13 15:03:20 user nova-compute[71507]: </domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:  {{(pid=71507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 13 15:03:20 user nova-compute[71507]: <domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 15:03:20 user nova-compute[71507]:   <domain>kvm</domain>
Apr 13 15:03:20 user nova-compute[71507]:   <machine>pc-q35-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:   <arch>i686</arch>
Apr 13 15:03:20 user nova-compute[71507]:   <vcpu max='288'/>
Apr 13 15:03:20 user nova-compute[71507]:   <iothreads supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:   <os supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='firmware'/>
Apr 13 15:03:20 user nova-compute[71507]:     <loader supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>rom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pflash</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='readonly'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='secure'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </loader>
Apr 13 15:03:20 user nova-compute[71507]:   </os>
Apr 13 15:03:20 user nova-compute[71507]:   <cpu>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-passthrough' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='hostPassthroughMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='maximum' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='maximumMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-model' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <vendor>Intel</vendor>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ss'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='vmx'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pcid'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='hypervisor'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arat'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='umip'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='md-clear'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibpb'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibrs'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='erms'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='lm'/>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='custom' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>qemu64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>qemu32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>phenom</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>n270</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>kvm64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>coreduo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>core2duo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>athlon</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Westmere</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Snowridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Penryn</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G5</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G4</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G1</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Nehalem</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Rome</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Milan</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Dhyana</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cooperlake</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Conroe</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>486</model>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:   </cpu>
Apr 13 15:03:20 user nova-compute[71507]:   <memoryBacking supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='sourceType'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>file</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>anonymous</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>memfd</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:   </memoryBacking>
Apr 13 15:03:20 user nova-compute[71507]:   <devices>
Apr 13 15:03:20 user nova-compute[71507]:     <disk supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='diskDevice'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>disk</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cdrom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>floppy</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>lun</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='bus'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>fdc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sata</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </disk>
Apr 13 15:03:20 user nova-compute[71507]:     <graphics supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sdl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vnc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>spice</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egl-headless</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </graphics>
Apr 13 15:03:20 user nova-compute[71507]:     <video supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='modelType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cirrus</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vmvga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>qxl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>none</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>bochs</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ramfb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </video>
Apr 13 15:03:20 user nova-compute[71507]:     <hostdev supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='mode'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>subsystem</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='startupPolicy'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>default</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>mandatory</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>requisite</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>optional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='subsysType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pci</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='capsType'/>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='pciBackend'/>
Apr 13 15:03:20 user nova-compute[71507]:     </hostdev>
Apr 13 15:03:20 user nova-compute[71507]:     <rng supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>random</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egd</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>builtin</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </rng>
Apr 13 15:03:20 user nova-compute[71507]:     <filesystem supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='driverType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>path</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>handle</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtiofs</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </filesystem>
Apr 13 15:03:20 user nova-compute[71507]:     <tpm supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-tis</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-crb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>passthrough</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>emulator</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </tpm>
Apr 13 15:03:20 user nova-compute[71507]:   </devices>
Apr 13 15:03:20 user nova-compute[71507]:   <features>
Apr 13 15:03:20 user nova-compute[71507]:     <gic supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     <vmcoreinfo supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <genid supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backingStoreInput supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backup supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <sev supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:   </features>
Apr 13 15:03:20 user nova-compute[71507]: </domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:  {{(pid=71507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 13 15:03:20 user nova-compute[71507]: <domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 15:03:20 user nova-compute[71507]:   <domain>kvm</domain>
Apr 13 15:03:20 user nova-compute[71507]:   <machine>pc-q35-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:   <arch>i686</arch>
Apr 13 15:03:20 user nova-compute[71507]:   <vcpu max='288'/>
Apr 13 15:03:20 user nova-compute[71507]:   <iothreads supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:   <os supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='firmware'/>
Apr 13 15:03:20 user nova-compute[71507]:     <loader supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>rom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pflash</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='readonly'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='secure'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </loader>
Apr 13 15:03:20 user nova-compute[71507]:   </os>
Apr 13 15:03:20 user nova-compute[71507]:   <cpu>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-passthrough' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='hostPassthroughMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='maximum' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='maximumMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-model' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <vendor>Intel</vendor>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ss'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='vmx'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pcid'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='hypervisor'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arat'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='umip'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='md-clear'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibpb'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibrs'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='erms'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='lm'/>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='custom' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>qemu64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>qemu32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>phenom</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>n270</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>kvm64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>coreduo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>core2duo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>athlon</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Westmere</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Snowridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Penryn</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G5</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G4</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G1</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Nehalem</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Rome</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Milan</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Dhyana</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cooperlake</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Conroe</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>486</model>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:   </cpu>
Apr 13 15:03:20 user nova-compute[71507]:   <memoryBacking supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='sourceType'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>file</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>anonymous</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>memfd</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:   </memoryBacking>
Apr 13 15:03:20 user nova-compute[71507]:   <devices>
Apr 13 15:03:20 user nova-compute[71507]:     <disk supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='diskDevice'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>disk</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cdrom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>floppy</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>lun</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='bus'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>fdc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sata</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </disk>
Apr 13 15:03:20 user nova-compute[71507]:     <graphics supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sdl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vnc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>spice</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egl-headless</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </graphics>
Apr 13 15:03:20 user nova-compute[71507]:     <video supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='modelType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cirrus</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vmvga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>qxl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>none</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>bochs</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ramfb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </video>
Apr 13 15:03:20 user nova-compute[71507]:     <hostdev supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='mode'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>subsystem</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='startupPolicy'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>default</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>mandatory</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>requisite</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>optional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='subsysType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pci</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='capsType'/>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='pciBackend'/>
Apr 13 15:03:20 user nova-compute[71507]:     </hostdev>
Apr 13 15:03:20 user nova-compute[71507]:     <rng supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>random</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egd</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>builtin</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </rng>
Apr 13 15:03:20 user nova-compute[71507]:     <filesystem supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='driverType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>path</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>handle</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtiofs</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </filesystem>
Apr 13 15:03:20 user nova-compute[71507]:     <tpm supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-tis</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-crb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>passthrough</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>emulator</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </tpm>
Apr 13 15:03:20 user nova-compute[71507]:   </devices>
Apr 13 15:03:20 user nova-compute[71507]:   <features>
Apr 13 15:03:20 user nova-compute[71507]:     <gic supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     <vmcoreinfo supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <genid supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backingStoreInput supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backup supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <sev supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:   </features>
Apr 13 15:03:20 user nova-compute[71507]: </domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:  {{(pid=71507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 13 15:03:20 user nova-compute[71507]: <domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 15:03:20 user nova-compute[71507]:   <domain>kvm</domain>
Apr 13 15:03:20 user nova-compute[71507]:   <machine>pc-i440fx-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:   <arch>x86_64</arch>
Apr 13 15:03:20 user nova-compute[71507]:   <vcpu max='255'/>
Apr 13 15:03:20 user nova-compute[71507]:   <iothreads supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:   <os supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='firmware'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>efi</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:     <loader supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>rom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pflash</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='readonly'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='secure'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </loader>
Apr 13 15:03:20 user nova-compute[71507]:   </os>
Apr 13 15:03:20 user nova-compute[71507]:   <cpu>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-passthrough' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='hostPassthroughMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='maximum' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='maximumMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-model' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <vendor>Intel</vendor>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ss'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='vmx'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pcid'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='hypervisor'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arat'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='umip'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='md-clear'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='invtsc'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibpb'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibrs'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='rsba'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='erms'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='custom' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>qemu64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>qemu32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>phenom</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>n270</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>coreduo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>core2duo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>athlon</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Westmere</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Snowridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Penryn</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G5</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G4</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Opteron_G1</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Nehalem</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Rome</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Milan</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Dhyana</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cooperlake</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Conroe</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>486</model>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:   </cpu>
Apr 13 15:03:20 user nova-compute[71507]:   <memoryBacking supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='sourceType'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>file</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>anonymous</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>memfd</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:   </memoryBacking>
Apr 13 15:03:20 user nova-compute[71507]:   <devices>
Apr 13 15:03:20 user nova-compute[71507]:     <disk supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='diskDevice'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>disk</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cdrom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>floppy</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>lun</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='bus'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ide</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>fdc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sata</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </disk>
Apr 13 15:03:20 user nova-compute[71507]:     <graphics supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sdl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vnc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>spice</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egl-headless</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </graphics>
Apr 13 15:03:20 user nova-compute[71507]:     <video supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='modelType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cirrus</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vmvga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>qxl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>none</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>bochs</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ramfb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </video>
Apr 13 15:03:20 user nova-compute[71507]:     <hostdev supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='mode'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>subsystem</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='startupPolicy'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>default</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>mandatory</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>requisite</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>optional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='subsysType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pci</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='capsType'/>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='pciBackend'/>
Apr 13 15:03:20 user nova-compute[71507]:     </hostdev>
Apr 13 15:03:20 user nova-compute[71507]:     <rng supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>random</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egd</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>builtin</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </rng>
Apr 13 15:03:20 user nova-compute[71507]:     <filesystem supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='driverType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>path</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>handle</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtiofs</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </filesystem>
Apr 13 15:03:20 user nova-compute[71507]:     <tpm supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-tis</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-crb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>passthrough</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>emulator</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </tpm>
Apr 13 15:03:20 user nova-compute[71507]:   </devices>
Apr 13 15:03:20 user nova-compute[71507]:   <features>
Apr 13 15:03:20 user nova-compute[71507]:     <gic supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     <vmcoreinfo supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <genid supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backingStoreInput supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backup supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <sev supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:   </features>
Apr 13 15:03:20 user nova-compute[71507]: </domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:  {{(pid=71507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 13 15:03:20 user nova-compute[71507]: <domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 15:03:20 user nova-compute[71507]:   <domain>kvm</domain>
Apr 13 15:03:20 user nova-compute[71507]:   <machine>pc-i440fx-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:   <arch>x86_64</arch>
Apr 13 15:03:20 user nova-compute[71507]:   <vcpu max='255'/>
Apr 13 15:03:20 user nova-compute[71507]:   <iothreads supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:   <os supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='firmware'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>efi</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:     <loader supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>rom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pflash</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='readonly'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='secure'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </loader>
Apr 13 15:03:20 user nova-compute[71507]:   </os>
Apr 13 15:03:20 user nova-compute[71507]:   <cpu>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-passthrough' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='hostPassthroughMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='maximum' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='maximumMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-model' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <vendor>Intel</vendor>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ss'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='vmx'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pcid'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='hypervisor'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arat'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='umip'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='md-clear'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='invtsc'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibpb'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibrs'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='rsba'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='erms'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='custom' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>qemu64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>qemu32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>phenom</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>n270</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>coreduo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>core2duo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>athlon</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Westmere</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Snowridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Penryn</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G5</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G4</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Opteron_G1</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Nehalem</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Rome</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Milan</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Dhyana</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cooperlake</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Conroe</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>486</model>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:   </cpu>
Apr 13 15:03:20 user nova-compute[71507]:   <memoryBacking supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='sourceType'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>file</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>anonymous</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>memfd</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:   </memoryBacking>
Apr 13 15:03:20 user nova-compute[71507]:   <devices>
Apr 13 15:03:20 user nova-compute[71507]:     <disk supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='diskDevice'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>disk</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cdrom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>floppy</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>lun</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='bus'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ide</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>fdc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sata</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </disk>
Apr 13 15:03:20 user nova-compute[71507]:     <graphics supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sdl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vnc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>spice</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egl-headless</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </graphics>
Apr 13 15:03:20 user nova-compute[71507]:     <video supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='modelType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cirrus</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vmvga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>qxl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>none</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>bochs</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ramfb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </video>
Apr 13 15:03:20 user nova-compute[71507]:     <hostdev supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='mode'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>subsystem</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='startupPolicy'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>default</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>mandatory</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>requisite</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>optional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='subsysType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pci</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='capsType'/>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='pciBackend'/>
Apr 13 15:03:20 user nova-compute[71507]:     </hostdev>
Apr 13 15:03:20 user nova-compute[71507]:     <rng supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>random</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egd</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>builtin</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </rng>
Apr 13 15:03:20 user nova-compute[71507]:     <filesystem supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='driverType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>path</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>handle</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtiofs</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </filesystem>
Apr 13 15:03:20 user nova-compute[71507]:     <tpm supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-tis</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-crb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>passthrough</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>emulator</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </tpm>
Apr 13 15:03:20 user nova-compute[71507]:   </devices>
Apr 13 15:03:20 user nova-compute[71507]:   <features>
Apr 13 15:03:20 user nova-compute[71507]:     <gic supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     <vmcoreinfo supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <genid supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backingStoreInput supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backup supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <sev supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:   </features>
Apr 13 15:03:20 user nova-compute[71507]: </domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:  {{(pid=71507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 13 15:03:20 user nova-compute[71507]: <domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 15:03:20 user nova-compute[71507]:   <domain>kvm</domain>
Apr 13 15:03:20 user nova-compute[71507]:   <machine>pc-q35-jammy</machine>
Apr 13 15:03:20 user nova-compute[71507]:   <arch>x86_64</arch>
Apr 13 15:03:20 user nova-compute[71507]:   <vcpu max='288'/>
Apr 13 15:03:20 user nova-compute[71507]:   <iothreads supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:   <os supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='firmware'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>efi</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:     <loader supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>rom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pflash</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='readonly'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='secure'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </loader>
Apr 13 15:03:20 user nova-compute[71507]:   </os>
Apr 13 15:03:20 user nova-compute[71507]:   <cpu>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-passthrough' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='hostPassthroughMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='maximum' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='maximumMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-model' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <vendor>Intel</vendor>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ss'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='vmx'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pcid'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='hypervisor'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arat'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='umip'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='md-clear'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='invtsc'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibpb'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibrs'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='rsba'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='erms'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='custom' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>qemu64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>qemu32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>phenom</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>n270</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>coreduo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>core2duo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>athlon</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Westmere</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Snowridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Penryn</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G5</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G4</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Opteron_G1</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Nehalem</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Rome</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Milan</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Dhyana</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cooperlake</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Conroe</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>486</model>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:   </cpu>
Apr 13 15:03:20 user nova-compute[71507]:   <memoryBacking supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='sourceType'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>file</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>anonymous</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>memfd</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:   </memoryBacking>
Apr 13 15:03:20 user nova-compute[71507]:   <devices>
Apr 13 15:03:20 user nova-compute[71507]:     <disk supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='diskDevice'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>disk</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cdrom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>floppy</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>lun</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='bus'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>fdc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sata</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </disk>
Apr 13 15:03:20 user nova-compute[71507]:     <graphics supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sdl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vnc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>spice</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egl-headless</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </graphics>
Apr 13 15:03:20 user nova-compute[71507]:     <video supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='modelType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cirrus</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vmvga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>qxl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>none</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>bochs</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ramfb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </video>
Apr 13 15:03:20 user nova-compute[71507]:     <hostdev supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='mode'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>subsystem</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='startupPolicy'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>default</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>mandatory</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>requisite</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>optional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='subsysType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pci</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='capsType'/>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='pciBackend'/>
Apr 13 15:03:20 user nova-compute[71507]:     </hostdev>
Apr 13 15:03:20 user nova-compute[71507]:     <rng supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>random</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egd</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>builtin</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </rng>
Apr 13 15:03:20 user nova-compute[71507]:     <filesystem supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='driverType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>path</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>handle</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtiofs</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </filesystem>
Apr 13 15:03:20 user nova-compute[71507]:     <tpm supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-tis</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-crb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>passthrough</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>emulator</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </tpm>
Apr 13 15:03:20 user nova-compute[71507]:   </devices>
Apr 13 15:03:20 user nova-compute[71507]:   <features>
Apr 13 15:03:20 user nova-compute[71507]:     <gic supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     <vmcoreinfo supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <genid supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backingStoreInput supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backup supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <sev supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:   </features>
Apr 13 15:03:20 user nova-compute[71507]: </domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:  {{(pid=71507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 13 15:03:20 user nova-compute[71507]: <domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 15:03:20 user nova-compute[71507]:   <domain>kvm</domain>
Apr 13 15:03:20 user nova-compute[71507]:   <machine>pc-q35-6.2</machine>
Apr 13 15:03:20 user nova-compute[71507]:   <arch>x86_64</arch>
Apr 13 15:03:20 user nova-compute[71507]:   <vcpu max='288'/>
Apr 13 15:03:20 user nova-compute[71507]:   <iothreads supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:   <os supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='firmware'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>efi</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:     <loader supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>rom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pflash</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='readonly'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='secure'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>yes</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>no</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </loader>
Apr 13 15:03:20 user nova-compute[71507]:   </os>
Apr 13 15:03:20 user nova-compute[71507]:   <cpu>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-passthrough' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='hostPassthroughMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='maximum' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='maximumMigratable'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>on</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>off</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='host-model' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <vendor>Intel</vendor>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ss'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='vmx'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pcid'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='hypervisor'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arat'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='umip'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='md-clear'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='invtsc'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibpb'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='ibrs'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-stibp'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='rsba'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='erms'/>
Apr 13 15:03:20 user nova-compute[71507]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:     <mode name='custom' supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>qemu64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>qemu32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>phenom</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>pentium</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>n270</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm64</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>kvm32</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>coreduo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>core2duo</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>athlon</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Westmere</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Snowridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Skylake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>SandyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Penryn</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G5</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G4</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G3</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Opteron_G2</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Opteron_G1</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Nehalem</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>IvyBridge</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Icelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Haswell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Rome</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-Milan</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>EPYC</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Dhyana</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cooperlake</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>Conroe</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='no'>Broadwell</model>
Apr 13 15:03:20 user nova-compute[71507]:       <model usable='yes'>486</model>
Apr 13 15:03:20 user nova-compute[71507]:     </mode>
Apr 13 15:03:20 user nova-compute[71507]:   </cpu>
Apr 13 15:03:20 user nova-compute[71507]:   <memoryBacking supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:     <enum name='sourceType'>
Apr 13 15:03:20 user nova-compute[71507]:       <value>file</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>anonymous</value>
Apr 13 15:03:20 user nova-compute[71507]:       <value>memfd</value>
Apr 13 15:03:20 user nova-compute[71507]:     </enum>
Apr 13 15:03:20 user nova-compute[71507]:   </memoryBacking>
Apr 13 15:03:20 user nova-compute[71507]:   <devices>
Apr 13 15:03:20 user nova-compute[71507]:     <disk supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='diskDevice'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>disk</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cdrom</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>floppy</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>lun</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='bus'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>fdc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sata</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </disk>
Apr 13 15:03:20 user nova-compute[71507]:     <graphics supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='type'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>sdl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vnc</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>spice</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egl-headless</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </graphics>
Apr 13 15:03:20 user nova-compute[71507]:     <video supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='modelType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>cirrus</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>vmvga</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>qxl</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>none</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>bochs</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>ramfb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </video>
Apr 13 15:03:20 user nova-compute[71507]:     <hostdev supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='mode'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>subsystem</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='startupPolicy'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>default</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>mandatory</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>requisite</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>optional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='subsysType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>usb</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>pci</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>scsi</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='capsType'/>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='pciBackend'/>
Apr 13 15:03:20 user nova-compute[71507]:     </hostdev>
Apr 13 15:03:20 user nova-compute[71507]:     <rng supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtio-non-transitional</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>random</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>egd</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>builtin</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </rng>
Apr 13 15:03:20 user nova-compute[71507]:     <filesystem supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='driverType'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>path</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>handle</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>virtiofs</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </filesystem>
Apr 13 15:03:20 user nova-compute[71507]:     <tpm supported='yes'>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='model'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-tis</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>tpm-crb</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:       <enum name='backendModel'>
Apr 13 15:03:20 user nova-compute[71507]:         <value>passthrough</value>
Apr 13 15:03:20 user nova-compute[71507]:         <value>emulator</value>
Apr 13 15:03:20 user nova-compute[71507]:       </enum>
Apr 13 15:03:20 user nova-compute[71507]:     </tpm>
Apr 13 15:03:20 user nova-compute[71507]:   </devices>
Apr 13 15:03:20 user nova-compute[71507]:   <features>
Apr 13 15:03:20 user nova-compute[71507]:     <gic supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:     <vmcoreinfo supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <genid supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backingStoreInput supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <backup supported='yes'/>
Apr 13 15:03:20 user nova-compute[71507]:     <sev supported='no'/>
Apr 13 15:03:20 user nova-compute[71507]:   </features>
Apr 13 15:03:20 user nova-compute[71507]: </domainCapabilities>
Apr 13 15:03:20 user nova-compute[71507]:  {{(pid=71507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Checking secure boot support for host arch (x86_64) {{(pid=71507) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Checking secure boot support for host arch (x86_64) {{(pid=71507) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Checking secure boot support for host arch (x86_64) {{(pid=71507) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Checking secure boot support for host arch (x86_64) {{(pid=71507) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Checking secure boot support for host arch (x86_64) {{(pid=71507) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 15:03:20 user nova-compute[71507]: INFO nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Secure Boot support detected
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] cpu compare xml: <cpu match="exact">
Apr 13 15:03:20 user nova-compute[71507]:   <model>Nehalem</model>
Apr 13 15:03:20 user nova-compute[71507]: </cpu>
Apr 13 15:03:20 user nova-compute[71507]:  {{(pid=71507) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 13 15:03:20 user nova-compute[71507]: INFO nova.virt.node [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Generated node identity d4bde90d-fb36-4cb3-9849-976dd28e1f71
Apr 13 15:03:20 user nova-compute[71507]: INFO nova.virt.node [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Wrote node identity d4bde90d-fb36-4cb3-9849-976dd28e1f71 to /opt/stack/data/nova/compute_id
Apr 13 15:03:20 user nova-compute[71507]: WARNING nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Compute nodes ['d4bde90d-fb36-4cb3-9849-976dd28e1f71'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 13 15:03:20 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 13 15:03:20 user nova-compute[71507]: WARNING nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 15:03:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:03:20 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:03:21 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:03:21 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Hypervisor/Node resource view: name=user free_ram=10816MB free_disk=26.994781494140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:03:21 user nova-compute[71507]: WARNING nova.compute.resource_tracker [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] No compute node record for user:d4bde90d-fb36-4cb3-9849-976dd28e1f71: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d4bde90d-fb36-4cb3-9849-976dd28e1f71 could not be found.
Apr 13 15:03:21 user nova-compute[71507]: INFO nova.compute.resource_tracker [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Compute node record created for user:user with uuid: d4bde90d-fb36-4cb3-9849-976dd28e1f71
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:03:21 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [req-0e86d59f-89f3-4257-8c6a-56e99b0c58b5] Created resource provider record via placement API for resource provider with UUID d4bde90d-fb36-4cb3-9849-976dd28e1f71 and name user.
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71507) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 13 15:03:21 user nova-compute[71507]: INFO nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] kernel doesn't support AMD SEV
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Libvirt baseline CPU <cpu>
Apr 13 15:03:21 user nova-compute[71507]:   <arch>x86_64</arch>
Apr 13 15:03:21 user nova-compute[71507]:   <model>Nehalem</model>
Apr 13 15:03:21 user nova-compute[71507]:   <vendor>Intel</vendor>
Apr 13 15:03:21 user nova-compute[71507]:   <topology sockets="6" cores="1" threads="1"/>
Apr 13 15:03:21 user nova-compute[71507]: </cpu>
Apr 13 15:03:21 user nova-compute[71507]:  {{(pid=71507) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Updated inventory for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Updating resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 generation from 0 to 1 during operation: update_inventory {{(pid=71507) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Updating resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 generation from 1 to 2 during operation: update_traits {{(pid=71507) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.service [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Creating RPC server for service compute {{(pid=71507) start /opt/stack/nova/nova/service.py:182}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.service [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Join ServiceGroup membership for this service compute {{(pid=71507) start /opt/stack/nova/nova/service.py:199}}
Apr 13 15:03:21 user nova-compute[71507]: DEBUG nova.servicegroup.drivers.db [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71507) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 13 15:03:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_power_states {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:03:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:04:12 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:04:12 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:04:12 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=10212MB free_disk=26.9085693359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:04:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:04:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:04:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:04:13 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:04:13 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:04:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:04:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:05:13 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:05:13 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:05:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=10178MB free_disk=26.955978393554688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:05:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:05:14 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:05:14 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:05:14 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:05:14 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:05:14 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:05:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:05:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:05:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:06:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:06:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:06:13 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:06:13 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:06:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=10162MB free_disk=26.730846405029297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:06:13 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:06:14 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:06:14 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:06:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:06:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:06:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:06:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:06:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:06:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:07:13 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:13 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=9451MB free_disk=26.761764526367188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:07:13 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:07:14 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:07:14 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:07:14 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:07:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:16 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:16 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:16 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:16 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:17 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:07:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "58a0788e-df82-4c1e-97dd-1d246048afc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:07:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:25 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:07:25 user nova-compute[71507]: INFO nova.compute.claims [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Claim successful on node user
Apr 13 15:07:25 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:07:25 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:07:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:07:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:07:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:07:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Creating image(s)
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "/opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "/opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "/opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:26 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:07:26 user nova-compute[71507]: INFO nova.compute.claims [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Claim successful on node user
Apr 13 15:07:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.virt.images [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 90e5cdd0-62b7-441b-9971-cfa8e8a0478d was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918.part /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.policy [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2844897ef27d4395af0a8f069699ce4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62589c1782f2473ead9b4270af3982f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918.part /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918.converted" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:07:27 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.929s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:27 user nova-compute[71507]: INFO oslo.privsep.daemon [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbhw_js48/privsep.sock']
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:07:27 user sudo[80241]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbhw_js48/privsep.sock
Apr 13 15:07:27 user sudo[80241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:07:27 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Creating image(s)
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:28 user nova-compute[71507]: DEBUG nova.policy [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:07:29 user sudo[80241]: pam_unix(sudo:session): session closed for user root
Apr 13 15:07:29 user nova-compute[71507]: INFO oslo.privsep.daemon [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Spawned new privsep daemon via rootwrap
Apr 13 15:07:29 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 15:07:29 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 15:07:29 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 15:07:29 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80247
Apr 13 15:07:29 user nova-compute[71507]: WARNING oslo_privsep.priv_context [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] privsep daemon already running
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Successfully created port: 393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "25f57234-8818-44d3-b476-d6cfba7b2810" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk 1073741824" returned: 0 in 0.047s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.189s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.192s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.226s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:07:29 user nova-compute[71507]: INFO nova.compute.claims [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Claim successful on node user
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk 1073741824" returned: 0 in 0.078s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Cannot resize image /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'migration_context' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Ensure instance console log exists: /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.174s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Cannot resize image /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lazy-loading 'migration_context' on Instance uuid 58a0788e-df82-4c1e-97dd-1d246048afc5 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Ensure instance console log exists: /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.network.neutron [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:07:30 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:07:30 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Creating image(s)
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.158s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.171s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk 1073741824" returned: 0 in 0.060s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG nova.policy [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.166s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Cannot resize image /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG nova.objects.instance [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'migration_context' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Ensure instance console log exists: /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:32 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Successfully created port: 0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:07:33 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Successfully updated port: 393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:07:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "refresh_cache-58a0788e-df82-4c1e-97dd-1d246048afc5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquired lock "refresh_cache-58a0788e-df82-4c1e-97dd-1d246048afc5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:33 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:07:33 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:07:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received event network-changed-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Refreshing instance network info cache due to event network-changed-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:07:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Acquiring lock "refresh_cache-58a0788e-df82-4c1e-97dd-1d246048afc5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:33 user nova-compute[71507]: DEBUG nova.network.neutron [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Successfully created port: e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:07:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Updating instance_info_cache with network_info: [{"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Releasing lock "refresh_cache-58a0788e-df82-4c1e-97dd-1d246048afc5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Instance network_info: |[{"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Acquired lock "refresh_cache-58a0788e-df82-4c1e-97dd-1d246048afc5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.neutron [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Refreshing network info cache for port 393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Start _get_guest_xml network_info=[{"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:07:35 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:35 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-282341879',display_name='tempest-DeleteServersTestJSON-server-282341879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-282341879',id=1,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62589c1782f2473ead9b4270af3982f6',ramdisk_id='',reservation_id='r-h5g2t326',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-425509443',owner_user_name='tempest-DeleteServersTestJSON-425509443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:26Z,user_data=None,user_id='2844897ef27d4395af0a8f069699ce4d',uuid=58a0788e-df82-4c1e-97dd-1d246048afc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Converting VIF {"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d1:0b,bridge_name='br-int',has_traffic_filtering=True,id=393596c3-b6ee-4d5e-bec9-d9e96b9bf93f,network=Network(1f3dba00-8e14-4683-8d13-ebc5e4395913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap393596c3-b6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lazy-loading 'pci_devices' on Instance uuid 58a0788e-df82-4c1e-97dd-1d246048afc5 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:07:35 user nova-compute[71507]:   <uuid>58a0788e-df82-4c1e-97dd-1d246048afc5</uuid>
Apr 13 15:07:35 user nova-compute[71507]:   <name>instance-00000001</name>
Apr 13 15:07:35 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:07:35 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:07:35 user nova-compute[71507]:   <metadata>
Apr 13 15:07:35 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:07:35 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:07:35 user nova-compute[71507]:       <nova:name>tempest-DeleteServersTestJSON-server-282341879</nova:name>
Apr 13 15:07:35 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:07:35</nova:creationTime>
Apr 13 15:07:35 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:07:35 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:07:35 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:07:35 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:07:35 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:07:35 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:07:35 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:07:35 user nova-compute[71507]:       <nova:owner>
Apr 13 15:07:35 user nova-compute[71507]:         <nova:user uuid="2844897ef27d4395af0a8f069699ce4d">tempest-DeleteServersTestJSON-425509443-project-member</nova:user>
Apr 13 15:07:35 user nova-compute[71507]:         <nova:project uuid="62589c1782f2473ead9b4270af3982f6">tempest-DeleteServersTestJSON-425509443</nova:project>
Apr 13 15:07:35 user nova-compute[71507]:       </nova:owner>
Apr 13 15:07:35 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:07:35 user nova-compute[71507]:       <nova:ports>
Apr 13 15:07:35 user nova-compute[71507]:         <nova:port uuid="393596c3-b6ee-4d5e-bec9-d9e96b9bf93f">
Apr 13 15:07:35 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 15:07:35 user nova-compute[71507]:         </nova:port>
Apr 13 15:07:35 user nova-compute[71507]:       </nova:ports>
Apr 13 15:07:35 user nova-compute[71507]:     </nova:instance>
Apr 13 15:07:35 user nova-compute[71507]:   </metadata>
Apr 13 15:07:35 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:07:35 user nova-compute[71507]:     <system>
Apr 13 15:07:35 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:07:35 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:07:35 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:07:35 user nova-compute[71507]:       <entry name="serial">58a0788e-df82-4c1e-97dd-1d246048afc5</entry>
Apr 13 15:07:35 user nova-compute[71507]:       <entry name="uuid">58a0788e-df82-4c1e-97dd-1d246048afc5</entry>
Apr 13 15:07:35 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:07:35 user nova-compute[71507]:     </system>
Apr 13 15:07:35 user nova-compute[71507]:   </sysinfo>
Apr 13 15:07:35 user nova-compute[71507]:   <os>
Apr 13 15:07:35 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:07:35 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:07:35 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:07:35 user nova-compute[71507]:   </os>
Apr 13 15:07:35 user nova-compute[71507]:   <features>
Apr 13 15:07:35 user nova-compute[71507]:     <acpi/>
Apr 13 15:07:35 user nova-compute[71507]:     <apic/>
Apr 13 15:07:35 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:07:35 user nova-compute[71507]:   </features>
Apr 13 15:07:35 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:07:35 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:07:35 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:07:35 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:07:35 user nova-compute[71507]:   </clock>
Apr 13 15:07:35 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:07:35 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:07:35 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:07:35 user nova-compute[71507]:   </cpu>
Apr 13 15:07:35 user nova-compute[71507]:   <devices>
Apr 13 15:07:35 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:07:35 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:07:35 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk"/>
Apr 13 15:07:35 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:07:35 user nova-compute[71507]:     </disk>
Apr 13 15:07:35 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:07:35 user nova-compute[71507]:       <mac address="fa:16:3e:d8:d1:0b"/>
Apr 13 15:07:35 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:35 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:07:35 user nova-compute[71507]:       <target dev="tap393596c3-b6"/>
Apr 13 15:07:35 user nova-compute[71507]:     </interface>
Apr 13 15:07:35 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:07:35 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/console.log" append="off"/>
Apr 13 15:07:35 user nova-compute[71507]:     </serial>
Apr 13 15:07:35 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:07:35 user nova-compute[71507]:     <video>
Apr 13 15:07:35 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:35 user nova-compute[71507]:     </video>
Apr 13 15:07:35 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:07:35 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:07:35 user nova-compute[71507]:     </rng>
Apr 13 15:07:35 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:07:35 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:07:35 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:07:35 user nova-compute[71507]:     </memballoon>
Apr 13 15:07:35 user nova-compute[71507]:   </devices>
Apr 13 15:07:35 user nova-compute[71507]: </domain>
Apr 13 15:07:35 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-282341879',display_name='tempest-DeleteServersTestJSON-server-282341879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-282341879',id=1,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62589c1782f2473ead9b4270af3982f6',ramdisk_id='',reservation_id='r-h5g2t326',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-425509443',owner_user_name='tempest-DeleteServersTestJSON-425509443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:26Z,user_data=None,user_id='2844897ef27d4395af0a8f069699ce4d',uuid=58a0788e-df82-4c1e-97dd-1d246048afc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Converting VIF {"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d1:0b,bridge_name='br-int',has_traffic_filtering=True,id=393596c3-b6ee-4d5e-bec9-d9e96b9bf93f,network=Network(1f3dba00-8e14-4683-8d13-ebc5e4395913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap393596c3-b6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG os_vif [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d1:0b,bridge_name='br-int',has_traffic_filtering=True,id=393596c3-b6ee-4d5e-bec9-d9e96b9bf93f,network=Network(1f3dba00-8e14-4683-8d13-ebc5e4395913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap393596c3-b6') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Created schema index Interface.name {{(pid=71507) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Created schema index Port.name {{(pid=71507) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Created schema index Bridge.name {{(pid=71507) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [POLLOUT] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:07:35 user nova-compute[71507]: INFO nova.compute.claims [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Claim successful on node user
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:07:35 user nova-compute[71507]: INFO oslo.privsep.daemon [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpib3ylbce/privsep.sock']
Apr 13 15:07:35 user sudo[80302]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpib3ylbce/privsep.sock
Apr 13 15:07:35 user sudo[80302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Successfully updated port: 0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquired lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:07:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:07:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Creating image(s)
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "/opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "/opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "/opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:35 user nova-compute[71507]: DEBUG nova.policy [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-changed-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Refreshing instance network info cache due to event network-changed-0d9b23f6-72f8-44b8-bf33-5abc1543e18d. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] Acquiring lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.127s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk 1073741824" returned: 0 in 0.045s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.122s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Cannot resize image /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'migration_context' on Instance uuid 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Ensure instance console log exists: /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updating instance_info_cache with network_info: [{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Releasing lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Instance network_info: |[{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Updated VIF entry in instance network info cache for port 393596c3-b6ee-4d5e-bec9-d9e96b9bf93f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Updating instance_info_cache with network_info: [{"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] Acquired lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Refreshing network info cache for port 0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Start _get_guest_xml network_info=[{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-02a20123-45df-463a-b84c-d5b68d8dfc17 req-569cceef-343e-4c24-9abf-2ccc3a46f797 service nova] Releasing lock "refresh_cache-58a0788e-df82-4c1e-97dd-1d246048afc5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:36 user sudo[80302]: pam_unix(sudo:session): session closed for user root
Apr 13 15:07:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:07:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-848115608',display_name='tempest-ServerRescueNegativeTestJSON-server-848115608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-848115608',id=2,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-q6b0p4z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:27Z,user_data=None,user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=f54cffe3-73da-468b-8252-b74cb4ba9653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d9b23f6-72f8-44b8-bf33-5abc1543e18d,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9b23f6-72') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'pci_devices' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:37 user nova-compute[71507]: INFO oslo.privsep.daemon [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Spawned new privsep daemon via rootwrap
Apr 13 15:07:37 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 15:07:37 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 15:07:37 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 13 15:07:37 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80322
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:07:37 user nova-compute[71507]:   <uuid>f54cffe3-73da-468b-8252-b74cb4ba9653</uuid>
Apr 13 15:07:37 user nova-compute[71507]:   <name>instance-00000002</name>
Apr 13 15:07:37 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:07:37 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:07:37 user nova-compute[71507]:   <metadata>
Apr 13 15:07:37 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:07:37 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:07:37 user nova-compute[71507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-848115608</nova:name>
Apr 13 15:07:37 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:07:36</nova:creationTime>
Apr 13 15:07:37 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:07:37 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:07:37 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:07:37 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:07:37 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:07:37 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:07:37 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:07:37 user nova-compute[71507]:       <nova:owner>
Apr 13 15:07:37 user nova-compute[71507]:         <nova:user uuid="c83940ddaaf64d94b40df9d00349aa91">tempest-ServerRescueNegativeTestJSON-66620130-project-member</nova:user>
Apr 13 15:07:37 user nova-compute[71507]:         <nova:project uuid="9bad96fcfa0d4691af2a7990ba9dbd09">tempest-ServerRescueNegativeTestJSON-66620130</nova:project>
Apr 13 15:07:37 user nova-compute[71507]:       </nova:owner>
Apr 13 15:07:37 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:07:37 user nova-compute[71507]:       <nova:ports>
Apr 13 15:07:37 user nova-compute[71507]:         <nova:port uuid="0d9b23f6-72f8-44b8-bf33-5abc1543e18d">
Apr 13 15:07:37 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 15:07:37 user nova-compute[71507]:         </nova:port>
Apr 13 15:07:37 user nova-compute[71507]:       </nova:ports>
Apr 13 15:07:37 user nova-compute[71507]:     </nova:instance>
Apr 13 15:07:37 user nova-compute[71507]:   </metadata>
Apr 13 15:07:37 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:07:37 user nova-compute[71507]:     <system>
Apr 13 15:07:37 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:07:37 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:07:37 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:07:37 user nova-compute[71507]:       <entry name="serial">f54cffe3-73da-468b-8252-b74cb4ba9653</entry>
Apr 13 15:07:37 user nova-compute[71507]:       <entry name="uuid">f54cffe3-73da-468b-8252-b74cb4ba9653</entry>
Apr 13 15:07:37 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:07:37 user nova-compute[71507]:     </system>
Apr 13 15:07:37 user nova-compute[71507]:   </sysinfo>
Apr 13 15:07:37 user nova-compute[71507]:   <os>
Apr 13 15:07:37 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:07:37 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:07:37 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:07:37 user nova-compute[71507]:   </os>
Apr 13 15:07:37 user nova-compute[71507]:   <features>
Apr 13 15:07:37 user nova-compute[71507]:     <acpi/>
Apr 13 15:07:37 user nova-compute[71507]:     <apic/>
Apr 13 15:07:37 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:07:37 user nova-compute[71507]:   </features>
Apr 13 15:07:37 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:07:37 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:07:37 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:07:37 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:07:37 user nova-compute[71507]:   </clock>
Apr 13 15:07:37 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:07:37 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:07:37 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:07:37 user nova-compute[71507]:   </cpu>
Apr 13 15:07:37 user nova-compute[71507]:   <devices>
Apr 13 15:07:37 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:07:37 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:07:37 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk"/>
Apr 13 15:07:37 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:07:37 user nova-compute[71507]:     </disk>
Apr 13 15:07:37 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:07:37 user nova-compute[71507]:       <mac address="fa:16:3e:45:ab:a1"/>
Apr 13 15:07:37 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:37 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:07:37 user nova-compute[71507]:       <target dev="tap0d9b23f6-72"/>
Apr 13 15:07:37 user nova-compute[71507]:     </interface>
Apr 13 15:07:37 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:07:37 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/console.log" append="off"/>
Apr 13 15:07:37 user nova-compute[71507]:     </serial>
Apr 13 15:07:37 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:07:37 user nova-compute[71507]:     <video>
Apr 13 15:07:37 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:37 user nova-compute[71507]:     </video>
Apr 13 15:07:37 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:07:37 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:07:37 user nova-compute[71507]:     </rng>
Apr 13 15:07:37 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:07:37 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:07:37 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:07:37 user nova-compute[71507]:     </memballoon>
Apr 13 15:07:37 user nova-compute[71507]:   </devices>
Apr 13 15:07:37 user nova-compute[71507]: </domain>
Apr 13 15:07:37 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-848115608',display_name='tempest-ServerRescueNegativeTestJSON-server-848115608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-848115608',id=2,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-q6b0p4z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:27Z,user_data=None,user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=f54cffe3-73da-468b-8252-b74cb4ba9653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d9b23f6-72f8-44b8-bf33-5abc1543e18d,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9b23f6-72') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG os_vif [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d9b23f6-72f8-44b8-bf33-5abc1543e18d,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9b23f6-72') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Successfully updated port: e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquired lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-changed-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Refreshing instance network info cache due to event network-changed-e4b886a7-88e3-42e3-98b8-b0fa9d67391a. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Acquiring lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d9b23f6-72, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d9b23f6-72, col_values=(('external_ids', {'iface-id': '0d9b23f6-72f8-44b8-bf33-5abc1543e18d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:ab:a1', 'vm-uuid': 'f54cffe3-73da-468b-8252-b74cb4ba9653'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Successfully created port: e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:37 user nova-compute[71507]: INFO os_vif [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d9b23f6-72f8-44b8-bf33-5abc1543e18d,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9b23f6-72')
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap393596c3-b6, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap393596c3-b6, col_values=(('external_ids', {'iface-id': '393596c3-b6ee-4d5e-bec9-d9e96b9bf93f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:d1:0b', 'vm-uuid': '58a0788e-df82-4c1e-97dd-1d246048afc5'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:37 user nova-compute[71507]: INFO os_vif [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d1:0b,bridge_name='br-int',has_traffic_filtering=True,id=393596c3-b6ee-4d5e-bec9-d9e96b9bf93f,network=Network(1f3dba00-8e14-4683-8d13-ebc5e4395913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap393596c3-b6')
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No VIF found with MAC fa:16:3e:45:ab:a1, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:07:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] No VIF found with MAC fa:16:3e:d8:d1:0b, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.network.neutron [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updating instance_info_cache with network_info: [{"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Releasing lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Instance network_info: |[{"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Acquired lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.network.neutron [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Refreshing network info cache for port e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Start _get_guest_xml network_info=[{"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:07:38 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:38 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-842194501',display_name='tempest-ServerRescueNegativeTestJSON-server-842194501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-842194501',id=3,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-lsu3syxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:31Z,user_data=None,user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=25f57234-8818-44d3-b476-d6cfba7b2810,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=e4b886a7-88e3-42e3-98b8-b0fa9d67391a,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b886a7-88') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.objects.instance [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'pci_devices' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.network.neutron [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updated VIF entry in instance network info cache for port 0d9b23f6-72f8-44b8-bf33-5abc1543e18d. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.network.neutron [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updating instance_info_cache with network_info: [{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:07:38 user nova-compute[71507]:   <uuid>25f57234-8818-44d3-b476-d6cfba7b2810</uuid>
Apr 13 15:07:38 user nova-compute[71507]:   <name>instance-00000003</name>
Apr 13 15:07:38 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:07:38 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:07:38 user nova-compute[71507]:   <metadata>
Apr 13 15:07:38 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:07:38 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:07:38 user nova-compute[71507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-842194501</nova:name>
Apr 13 15:07:38 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:07:38</nova:creationTime>
Apr 13 15:07:38 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:07:38 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:07:38 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:07:38 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:07:38 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:07:38 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:07:38 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:07:38 user nova-compute[71507]:       <nova:owner>
Apr 13 15:07:38 user nova-compute[71507]:         <nova:user uuid="c83940ddaaf64d94b40df9d00349aa91">tempest-ServerRescueNegativeTestJSON-66620130-project-member</nova:user>
Apr 13 15:07:38 user nova-compute[71507]:         <nova:project uuid="9bad96fcfa0d4691af2a7990ba9dbd09">tempest-ServerRescueNegativeTestJSON-66620130</nova:project>
Apr 13 15:07:38 user nova-compute[71507]:       </nova:owner>
Apr 13 15:07:38 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:07:38 user nova-compute[71507]:       <nova:ports>
Apr 13 15:07:38 user nova-compute[71507]:         <nova:port uuid="e4b886a7-88e3-42e3-98b8-b0fa9d67391a">
Apr 13 15:07:38 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 15:07:38 user nova-compute[71507]:         </nova:port>
Apr 13 15:07:38 user nova-compute[71507]:       </nova:ports>
Apr 13 15:07:38 user nova-compute[71507]:     </nova:instance>
Apr 13 15:07:38 user nova-compute[71507]:   </metadata>
Apr 13 15:07:38 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:07:38 user nova-compute[71507]:     <system>
Apr 13 15:07:38 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:07:38 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:07:38 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:07:38 user nova-compute[71507]:       <entry name="serial">25f57234-8818-44d3-b476-d6cfba7b2810</entry>
Apr 13 15:07:38 user nova-compute[71507]:       <entry name="uuid">25f57234-8818-44d3-b476-d6cfba7b2810</entry>
Apr 13 15:07:38 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:07:38 user nova-compute[71507]:     </system>
Apr 13 15:07:38 user nova-compute[71507]:   </sysinfo>
Apr 13 15:07:38 user nova-compute[71507]:   <os>
Apr 13 15:07:38 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:07:38 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:07:38 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:07:38 user nova-compute[71507]:   </os>
Apr 13 15:07:38 user nova-compute[71507]:   <features>
Apr 13 15:07:38 user nova-compute[71507]:     <acpi/>
Apr 13 15:07:38 user nova-compute[71507]:     <apic/>
Apr 13 15:07:38 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:07:38 user nova-compute[71507]:   </features>
Apr 13 15:07:38 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:07:38 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:07:38 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:07:38 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:07:38 user nova-compute[71507]:   </clock>
Apr 13 15:07:38 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:07:38 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:07:38 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:07:38 user nova-compute[71507]:   </cpu>
Apr 13 15:07:38 user nova-compute[71507]:   <devices>
Apr 13 15:07:38 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:07:38 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:07:38 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk"/>
Apr 13 15:07:38 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:07:38 user nova-compute[71507]:     </disk>
Apr 13 15:07:38 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:07:38 user nova-compute[71507]:       <mac address="fa:16:3e:c7:dd:13"/>
Apr 13 15:07:38 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:38 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:07:38 user nova-compute[71507]:       <target dev="tape4b886a7-88"/>
Apr 13 15:07:38 user nova-compute[71507]:     </interface>
Apr 13 15:07:38 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:07:38 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/console.log" append="off"/>
Apr 13 15:07:38 user nova-compute[71507]:     </serial>
Apr 13 15:07:38 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:07:38 user nova-compute[71507]:     <video>
Apr 13 15:07:38 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:38 user nova-compute[71507]:     </video>
Apr 13 15:07:38 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:07:38 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:07:38 user nova-compute[71507]:     </rng>
Apr 13 15:07:38 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:07:38 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:07:38 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:07:38 user nova-compute[71507]:     </memballoon>
Apr 13 15:07:38 user nova-compute[71507]:   </devices>
Apr 13 15:07:38 user nova-compute[71507]: </domain>
Apr 13 15:07:38 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-842194501',display_name='tempest-ServerRescueNegativeTestJSON-server-842194501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-842194501',id=3,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-lsu3syxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:31Z,user_data=None,user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=25f57234-8818-44d3-b476-d6cfba7b2810,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=e4b886a7-88e3-42e3-98b8-b0fa9d67391a,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b886a7-88') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG os_vif [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=e4b886a7-88e3-42e3-98b8-b0fa9d67391a,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b886a7-88') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-319d17d7-90cd-4eb6-8caf-b5526bd8dcb5 req-e070ffd0-de26-454a-815c-1f4e82474e61 service nova] Releasing lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4b886a7-88, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4b886a7-88, col_values=(('external_ids', {'iface-id': 'e4b886a7-88e3-42e3-98b8-b0fa9d67391a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:dd:13', 'vm-uuid': '25f57234-8818-44d3-b476-d6cfba7b2810'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:38 user nova-compute[71507]: INFO os_vif [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=e4b886a7-88e3-42e3-98b8-b0fa9d67391a,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b886a7-88')
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:07:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No VIF found with MAC fa:16:3e:c7:dd:13, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG nova.network.neutron [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updated VIF entry in instance network info cache for port e4b886a7-88e3-42e3-98b8-b0fa9d67391a. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG nova.network.neutron [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updating instance_info_cache with network_info: [{"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-79f57a87-d663-418e-aff8-f68ed8341262 req-a6552358-7016-4e09-b4f8-ed9c49d96420 service nova] Releasing lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:07:39 user nova-compute[71507]: INFO nova.compute.claims [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Claim successful on node user
Apr 13 15:07:39 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:07:40 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Successfully updated port: e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquired lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.policy [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b30a69b780664742aed58bd9a578e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5acb52755c74d118d012e38feed7237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:07:40 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Creating image(s)
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.162s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received event network-changed-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Refreshing instance network info cache due to event network-changed-e2b989b1-9194-48e5-a3e4-e35566440e3d. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] Acquiring lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk 1073741824" returned: 0 in 0.041s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Checking if we can resize image /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Cannot resize image /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'migration_context' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Ensure instance console log exists: /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updating instance_info_cache with network_info: [{"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Releasing lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Instance network_info: |[{"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] Acquired lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.network.neutron [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Refreshing network info cache for port e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Start _get_guest_xml network_info=[{"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:07:41 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:41 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-464267024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-464267024',id=4,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-fxa6n0q3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:36Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=37ff2115-ebfa-4cd2-b52f-89e354f0f5ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:65:54,bridge_name='br-int',has_traffic_filtering=True,id=e2b989b1-9194-48e5-a3e4-e35566440e3d,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b989b1-91') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'pci_devices' on Instance uuid 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:07:41 user nova-compute[71507]:   <uuid>37ff2115-ebfa-4cd2-b52f-89e354f0f5ba</uuid>
Apr 13 15:07:41 user nova-compute[71507]:   <name>instance-00000004</name>
Apr 13 15:07:41 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:07:41 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:07:41 user nova-compute[71507]:   <metadata>
Apr 13 15:07:41 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:07:41 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:07:41 user nova-compute[71507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-464267024</nova:name>
Apr 13 15:07:41 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:07:41</nova:creationTime>
Apr 13 15:07:41 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:07:41 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:07:41 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:07:41 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:07:41 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:07:41 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:07:41 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:07:41 user nova-compute[71507]:       <nova:owner>
Apr 13 15:07:41 user nova-compute[71507]:         <nova:user uuid="75bf6e19993f4c2e90fd52c4d6212622">tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member</nova:user>
Apr 13 15:07:41 user nova-compute[71507]:         <nova:project uuid="240b28f42732478ba732994b2c9e3fbe">tempest-ServerBootFromVolumeStableRescueTest-1009244781</nova:project>
Apr 13 15:07:41 user nova-compute[71507]:       </nova:owner>
Apr 13 15:07:41 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:07:41 user nova-compute[71507]:       <nova:ports>
Apr 13 15:07:41 user nova-compute[71507]:         <nova:port uuid="e2b989b1-9194-48e5-a3e4-e35566440e3d">
Apr 13 15:07:41 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 15:07:41 user nova-compute[71507]:         </nova:port>
Apr 13 15:07:41 user nova-compute[71507]:       </nova:ports>
Apr 13 15:07:41 user nova-compute[71507]:     </nova:instance>
Apr 13 15:07:41 user nova-compute[71507]:   </metadata>
Apr 13 15:07:41 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:07:41 user nova-compute[71507]:     <system>
Apr 13 15:07:41 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:07:41 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:07:41 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:07:41 user nova-compute[71507]:       <entry name="serial">37ff2115-ebfa-4cd2-b52f-89e354f0f5ba</entry>
Apr 13 15:07:41 user nova-compute[71507]:       <entry name="uuid">37ff2115-ebfa-4cd2-b52f-89e354f0f5ba</entry>
Apr 13 15:07:41 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:07:41 user nova-compute[71507]:     </system>
Apr 13 15:07:41 user nova-compute[71507]:   </sysinfo>
Apr 13 15:07:41 user nova-compute[71507]:   <os>
Apr 13 15:07:41 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:07:41 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:07:41 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:07:41 user nova-compute[71507]:   </os>
Apr 13 15:07:41 user nova-compute[71507]:   <features>
Apr 13 15:07:41 user nova-compute[71507]:     <acpi/>
Apr 13 15:07:41 user nova-compute[71507]:     <apic/>
Apr 13 15:07:41 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:07:41 user nova-compute[71507]:   </features>
Apr 13 15:07:41 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:07:41 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:07:41 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:07:41 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:07:41 user nova-compute[71507]:   </clock>
Apr 13 15:07:41 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:07:41 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:07:41 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:07:41 user nova-compute[71507]:   </cpu>
Apr 13 15:07:41 user nova-compute[71507]:   <devices>
Apr 13 15:07:41 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:07:41 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:07:41 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk"/>
Apr 13 15:07:41 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:07:41 user nova-compute[71507]:     </disk>
Apr 13 15:07:41 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:07:41 user nova-compute[71507]:       <mac address="fa:16:3e:9a:65:54"/>
Apr 13 15:07:41 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:41 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:07:41 user nova-compute[71507]:       <target dev="tape2b989b1-91"/>
Apr 13 15:07:41 user nova-compute[71507]:     </interface>
Apr 13 15:07:41 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:07:41 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/console.log" append="off"/>
Apr 13 15:07:41 user nova-compute[71507]:     </serial>
Apr 13 15:07:41 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:07:41 user nova-compute[71507]:     <video>
Apr 13 15:07:41 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:41 user nova-compute[71507]:     </video>
Apr 13 15:07:41 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:07:41 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:07:41 user nova-compute[71507]:     </rng>
Apr 13 15:07:41 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:07:41 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:07:41 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:07:41 user nova-compute[71507]:     </memballoon>
Apr 13 15:07:41 user nova-compute[71507]:   </devices>
Apr 13 15:07:41 user nova-compute[71507]: </domain>
Apr 13 15:07:41 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-464267024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-464267024',id=4,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-fxa6n0q3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:36Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=37ff2115-ebfa-4cd2-b52f-89e354f0f5ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:65:54,bridge_name='br-int',has_traffic_filtering=True,id=e2b989b1-9194-48e5-a3e4-e35566440e3d,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b989b1-91') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG os_vif [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:65:54,bridge_name='br-int',has_traffic_filtering=True,id=e2b989b1-9194-48e5-a3e4-e35566440e3d,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b989b1-91') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2b989b1-91, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2b989b1-91, col_values=(('external_ids', {'iface-id': 'e2b989b1-9194-48e5-a3e4-e35566440e3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:65:54', 'vm-uuid': '37ff2115-ebfa-4cd2-b52f-89e354f0f5ba'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:41 user nova-compute[71507]: INFO os_vif [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:65:54,bridge_name='br-int',has_traffic_filtering=True,id=e2b989b1-9194-48e5-a3e4-e35566440e3d,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b989b1-91')
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No VIF found with MAC fa:16:3e:9a:65:54, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:07:41 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Successfully created port: a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:42 user nova-compute[71507]: WARNING nova.compute.manager [req-75c918c1-c4cb-4575-9dd3-ed9f37aad1db req-1afc5b8e-b156-4f21-8502-18f35920bd1a service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state building and task_state spawning.
Apr 13 15:07:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received event network-vif-plugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] Acquiring lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] No waiting events found dispatching network-vif-plugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:42 user nova-compute[71507]: WARNING nova.compute.manager [req-68751c19-f6b5-4974-bba4-51e73c740640 req-ebd486f1-368b-491f-8595-9c8d467fdbd9 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received unexpected event network-vif-plugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance with vm_state building and task_state spawning.
Apr 13 15:07:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:43 user nova-compute[71507]: DEBUG nova.network.neutron [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updated VIF entry in instance network info cache for port e2b989b1-9194-48e5-a3e4-e35566440e3d. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:07:43 user nova-compute[71507]: DEBUG nova.network.neutron [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updating instance_info_cache with network_info: [{"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11b8739e-5cdd-44bf-82b7-2fc3825c1df9 req-785e39d3-7c46-476d-a138-a448e55ddcd0 service nova] Releasing lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:44 user nova-compute[71507]: WARNING nova.compute.manager [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state building and task_state spawning.
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] No waiting events found dispatching network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:44 user nova-compute[71507]: WARNING nova.compute.manager [req-bfe591b6-718e-4931-b7f3-92631310902f req-e7272171-9cb7-4b98-8555-c56178901d51 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received unexpected event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance with vm_state building and task_state spawning.
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Successfully updated port: a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquired lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received event network-vif-plugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] Acquiring lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] No waiting events found dispatching network-vif-plugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:44 user nova-compute[71507]: WARNING nova.compute.manager [req-c53eab12-c4f7-46f9-a238-2b0a11736bc2 req-b61fc33a-f335-4d28-99e3-6893c8026e2f service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received unexpected event network-vif-plugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance with vm_state building and task_state spawning.
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398464.91754, 58a0788e-df82-4c1e-97dd-1d246048afc5 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:44 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] VM Resumed (Lifecycle Event)
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:07:44 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Instance spawned successfully.
Apr 13 15:07:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398464.9250267, 58a0788e-df82-4c1e-97dd-1d246048afc5 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] VM Started (Lifecycle Event)
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Took 18.92 seconds to spawn the instance on the hypervisor.
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Took 20.01 seconds to build instance.
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398465.5479836, f54cffe3-73da-468b-8252-b74cb4ba9653 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] VM Resumed (Lifecycle Event)
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9403bb4c-0ae0-4fea-b2eb-a13611813f6d tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.267s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Instance spawned successfully.
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398465.5557568, f54cffe3-73da-468b-8252-b74cb4ba9653 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] VM Started (Lifecycle Event)
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating instance_info_cache with network_info: [{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Releasing lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Instance network_info: |[{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Start _get_guest_xml network_info=[{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:07:45 user nova-compute[71507]: INFO nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Took 18.34 seconds to spawn the instance on the hypervisor.
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:45 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:45 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1909171132',display_name='tempest-ServerStableDeviceRescueTest-server-1909171132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1909171132',id=5,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6aSZKMD7DZRWnRyQAYKNVncY9MliP5yy+hr0mgok5IZOsUvvcpOVyIYwqoPxDEzOUN1HvhtDQMVs5WOR8xHMOt96WLfesTfqwvy1g4TGHpkWUPIHKMkqgOoitvtlLAkg==',key_name='tempest-keypair-135051856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5acb52755c74d118d012e38feed7237',ramdisk_id='',reservation_id='r-il3m75mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-147407416',owner_user_name='tempest-ServerStableDeviceRescueTest-147407416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b30a69b780664742aed58bd9a578e873',uuid=654608ee-5897-429a-b19c-6845d4e84818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Converting VIF {"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:62,bridge_name='br-int',has_traffic_filtering=True,id=a534f901-d679-4443-bf28-aaba09bf631f,network=Network(1cdb762d-7c09-4d16-bd83-31a75edb8a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa534f901-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'pci_devices' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:07:45 user nova-compute[71507]:   <uuid>654608ee-5897-429a-b19c-6845d4e84818</uuid>
Apr 13 15:07:45 user nova-compute[71507]:   <name>instance-00000005</name>
Apr 13 15:07:45 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:07:45 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:07:45 user nova-compute[71507]:   <metadata>
Apr 13 15:07:45 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:07:45 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:07:45 user nova-compute[71507]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1909171132</nova:name>
Apr 13 15:07:45 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:07:45</nova:creationTime>
Apr 13 15:07:45 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:07:45 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:07:45 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:07:45 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:07:45 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:07:45 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:07:45 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:07:45 user nova-compute[71507]:       <nova:owner>
Apr 13 15:07:45 user nova-compute[71507]:         <nova:user uuid="b30a69b780664742aed58bd9a578e873">tempest-ServerStableDeviceRescueTest-147407416-project-member</nova:user>
Apr 13 15:07:45 user nova-compute[71507]:         <nova:project uuid="b5acb52755c74d118d012e38feed7237">tempest-ServerStableDeviceRescueTest-147407416</nova:project>
Apr 13 15:07:45 user nova-compute[71507]:       </nova:owner>
Apr 13 15:07:45 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:07:45 user nova-compute[71507]:       <nova:ports>
Apr 13 15:07:45 user nova-compute[71507]:         <nova:port uuid="a534f901-d679-4443-bf28-aaba09bf631f">
Apr 13 15:07:45 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 15:07:45 user nova-compute[71507]:         </nova:port>
Apr 13 15:07:45 user nova-compute[71507]:       </nova:ports>
Apr 13 15:07:45 user nova-compute[71507]:     </nova:instance>
Apr 13 15:07:45 user nova-compute[71507]:   </metadata>
Apr 13 15:07:45 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:07:45 user nova-compute[71507]:     <system>
Apr 13 15:07:45 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:07:45 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:07:45 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:07:45 user nova-compute[71507]:       <entry name="serial">654608ee-5897-429a-b19c-6845d4e84818</entry>
Apr 13 15:07:45 user nova-compute[71507]:       <entry name="uuid">654608ee-5897-429a-b19c-6845d4e84818</entry>
Apr 13 15:07:45 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:07:45 user nova-compute[71507]:     </system>
Apr 13 15:07:45 user nova-compute[71507]:   </sysinfo>
Apr 13 15:07:45 user nova-compute[71507]:   <os>
Apr 13 15:07:45 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:07:45 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:07:45 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:07:45 user nova-compute[71507]:   </os>
Apr 13 15:07:45 user nova-compute[71507]:   <features>
Apr 13 15:07:45 user nova-compute[71507]:     <acpi/>
Apr 13 15:07:45 user nova-compute[71507]:     <apic/>
Apr 13 15:07:45 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:07:45 user nova-compute[71507]:   </features>
Apr 13 15:07:45 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:07:45 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:07:45 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:07:45 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:07:45 user nova-compute[71507]:   </clock>
Apr 13 15:07:45 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:07:45 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:07:45 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:07:45 user nova-compute[71507]:   </cpu>
Apr 13 15:07:45 user nova-compute[71507]:   <devices>
Apr 13 15:07:45 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:07:45 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:07:45 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk"/>
Apr 13 15:07:45 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:07:45 user nova-compute[71507]:     </disk>
Apr 13 15:07:45 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:07:45 user nova-compute[71507]:       <mac address="fa:16:3e:2a:ca:62"/>
Apr 13 15:07:45 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:45 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:07:45 user nova-compute[71507]:       <target dev="tapa534f901-d6"/>
Apr 13 15:07:45 user nova-compute[71507]:     </interface>
Apr 13 15:07:45 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:07:45 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/console.log" append="off"/>
Apr 13 15:07:45 user nova-compute[71507]:     </serial>
Apr 13 15:07:45 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:07:45 user nova-compute[71507]:     <video>
Apr 13 15:07:45 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:07:45 user nova-compute[71507]:     </video>
Apr 13 15:07:45 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:07:45 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:07:45 user nova-compute[71507]:     </rng>
Apr 13 15:07:45 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:07:45 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:07:45 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:07:45 user nova-compute[71507]:     </memballoon>
Apr 13 15:07:45 user nova-compute[71507]:   </devices>
Apr 13 15:07:45 user nova-compute[71507]: </domain>
Apr 13 15:07:45 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1909171132',display_name='tempest-ServerStableDeviceRescueTest-server-1909171132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1909171132',id=5,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6aSZKMD7DZRWnRyQAYKNVncY9MliP5yy+hr0mgok5IZOsUvvcpOVyIYwqoPxDEzOUN1HvhtDQMVs5WOR8xHMOt96WLfesTfqwvy1g4TGHpkWUPIHKMkqgOoitvtlLAkg==',key_name='tempest-keypair-135051856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5acb52755c74d118d012e38feed7237',ramdisk_id='',reservation_id='r-il3m75mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-147407416',owner_user_name='tempest-ServerStableDeviceRescueTest-147407416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b30a69b780664742aed58bd9a578e873',uuid=654608ee-5897-429a-b19c-6845d4e84818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Converting VIF {"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:62,bridge_name='br-int',has_traffic_filtering=True,id=a534f901-d679-4443-bf28-aaba09bf631f,network=Network(1cdb762d-7c09-4d16-bd83-31a75edb8a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa534f901-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG os_vif [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:62,bridge_name='br-int',has_traffic_filtering=True,id=a534f901-d679-4443-bf28-aaba09bf631f,network=Network(1cdb762d-7c09-4d16-bd83-31a75edb8a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa534f901-d6') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa534f901-d6, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa534f901-d6, col_values=(('external_ids', {'iface-id': 'a534f901-d679-4443-bf28-aaba09bf631f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:ca:62', 'vm-uuid': '654608ee-5897-429a-b19c-6845d4e84818'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:07:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:45 user nova-compute[71507]: INFO os_vif [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:62,bridge_name='br-int',has_traffic_filtering=True,id=a534f901-d679-4443-bf28-aaba09bf631f,network=Network(1cdb762d-7c09-4d16-bd83-31a75edb8a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa534f901-d6')
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.compute.manager [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Took 19.51 seconds to build instance.
Apr 13 15:07:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcb74173-959a-4ff5-86e3-ad4304769db0 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.678s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] No VIF found with MAC fa:16:3e:2a:ca:62, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] No waiting events found dispatching network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:46 user nova-compute[71507]: WARNING nova.compute.manager [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received unexpected event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance with vm_state building and task_state spawning.
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-changed-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Refreshing instance network info cache due to event network-changed-a534f901-d679-4443-bf28-aaba09bf631f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Acquiring lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Acquired lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.network.neutron [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Refreshing network info cache for port a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398466.3306448, 25f57234-8818-44d3-b476-d6cfba7b2810 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] VM Resumed (Lifecycle Event)
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Instance spawned successfully.
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398466.3446355, 25f57234-8818-44d3-b476-d6cfba7b2810 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] VM Started (Lifecycle Event)
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Took 15.96 seconds to spawn the instance on the hypervisor.
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.compute.manager [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Took 17.02 seconds to build instance.
Apr 13 15:07:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-62d85d4d-6a49-43e2-9f03-50fe9c9fe943 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "25f57234-8818-44d3-b476-d6cfba7b2810" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.235s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398466.9222453, 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] VM Resumed (Lifecycle Event)
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:07:46 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Instance spawned successfully.
Apr 13 15:07:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received event network-vif-plugged-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Acquiring lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] No waiting events found dispatching network-vif-plugged-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:47 user nova-compute[71507]: WARNING nova.compute.manager [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received unexpected event network-vif-plugged-e2b989b1-9194-48e5-a3e4-e35566440e3d for instance with vm_state building and task_state spawning.
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received event network-vif-plugged-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Acquiring lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] No waiting events found dispatching network-vif-plugged-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:47 user nova-compute[71507]: WARNING nova.compute.manager [req-8b06b10c-f082-46f9-a73e-48857d10b0fd req-686b92f9-8e3a-4c56-a70a-776a1dec8e37 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received unexpected event network-vif-plugged-e2b989b1-9194-48e5-a3e4-e35566440e3d for instance with vm_state building and task_state spawning.
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:47 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398466.9227543, 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:47 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] VM Started (Lifecycle Event)
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:47 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:47 user nova-compute[71507]: INFO nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Took 11.41 seconds to spawn the instance on the hypervisor.
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:47 user nova-compute[71507]: INFO nova.compute.manager [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Took 12.37 seconds to build instance.
Apr 13 15:07:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7a0ae7e-dab1-4ef8-b4d5-373de13a1618 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.527s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.network.neutron [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updated VIF entry in instance network info cache for port a534f901-d679-4443-bf28-aaba09bf631f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG nova.network.neutron [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating instance_info_cache with network_info: [{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ed841e17-b004-41e2-839c-2bd03cbf6c69 req-6a338af2-f267-4080-9377-6dd5bff24da2 service nova] Releasing lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:50 user nova-compute[71507]: WARNING nova.compute.manager [req-63d5b249-0000-4f7b-bc0c-a582dd023c94 req-0152f065-d4fa-4e7a-b72a-79b828306f2e service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state building and task_state spawning.
Apr 13 15:07:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398471.3432248, 654608ee-5897-429a-b19c-6845d4e84818 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:51 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] VM Resumed (Lifecycle Event)
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:07:51 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Instance spawned successfully.
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:51 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398471.347446, 654608ee-5897-429a-b19c-6845d4e84818 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:07:51 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] VM Started (Lifecycle Event)
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:07:51 user nova-compute[71507]: INFO nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Took 11.40 seconds to spawn the instance on the hypervisor.
Apr 13 15:07:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:07:51 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:07:51 user nova-compute[71507]: INFO nova.compute.manager [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Took 12.43 seconds to build instance.
Apr 13 15:07:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e90a7d09-dfbd-457b-a4cd-8c1e8dbd514f tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.595s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:07:52 user nova-compute[71507]: WARNING nova.compute.manager [req-c2876e72-243f-40d4-b512-784094baee36 req-77ffb579-d971-47d6-8989-b0bd4ff95803 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state None.
Apr 13 15:07:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "63f69337-7ae4-4125-a560-f6cbcb2298d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:07:55 user nova-compute[71507]: INFO nova.compute.claims [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Claim successful on node user
Apr 13 15:07:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:07:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.873s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.771s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:07:56 user nova-compute[71507]: INFO nova.compute.claims [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Claim successful on node user
Apr 13 15:07:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG nova.network.neutron [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:07:56 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:07:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:07:56 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Creating image(s)
Apr 13 15:07:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "/opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "/opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "/opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.046s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.policy [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8adc8b289e548a5ac16b6356753d6dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c1b992977a479883e445330b3d0d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.176s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.207s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.123s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk 1073741824" returned: 0 in 0.071s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.network.neutron [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:07:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.231s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.policy [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6747b03238c481d836caaf583f20a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fbef55fb3c43d69af48208d28c87f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Cannot resize image /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lazy-loading 'migration_context' on Instance uuid 63f69337-7ae4-4125-a560-f6cbcb2298d4 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Ensure instance console log exists: /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:07:58 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Creating image(s)
Apr 13 15:07:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "/opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "/opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "/opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "456be0b2f334e9d25db2e576f9535290185dfc13" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "456be0b2f334e9d25db2e576f9535290185dfc13" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG nova.network.neutron [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Successfully created port: f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13.part --force-share --output=json" returned: 0 in 0.220s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG nova.virt.images [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 1b4e800e-2bfa-417d-a618-befe946371e7 was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:07:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13.part /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG nova.network.neutron [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Successfully created port: a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13.part /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13.converted" returned: 0 in 0.258s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "456be0b2f334e9d25db2e576f9535290185dfc13" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.183s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13 --force-share --output=json" returned: 0 in 0.221s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "456be0b2f334e9d25db2e576f9535290185dfc13" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "456be0b2f334e9d25db2e576f9535290185dfc13" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:07:59 user nova-compute[71507]: DEBUG nova.network.neutron [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Successfully updated port: f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13 --force-share --output=json" returned: 0 in 0.324s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13,backing_fmt=raw /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "refresh_cache-63f69337-7ae4-4125-a560-f6cbcb2298d4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquired lock "refresh_cache-63f69337-7ae4-4125-a560-f6cbcb2298d4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received event network-changed-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Refreshing instance network info cache due to event network-changed-f1e3287f-407f-49f2-8d91-881e31471ee9. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] Acquiring lock "refresh_cache-63f69337-7ae4-4125-a560-f6cbcb2298d4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13,backing_fmt=raw /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk 1073741824" returned: 0 in 0.115s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "456be0b2f334e9d25db2e576f9535290185dfc13" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.444s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13 --force-share --output=json" returned: 0 in 0.212s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Successfully updated port: a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "refresh_cache-051e6c4e-3d10-4b43-9099-7abffd84d0d9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquired lock "refresh_cache-051e6c4e-3d10-4b43-9099-7abffd84d0d9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received event network-changed-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Refreshing instance network info cache due to event network-changed-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] Acquiring lock "refresh_cache-051e6c4e-3d10-4b43-9099-7abffd84d0d9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Cannot resize image /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.objects.instance [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lazy-loading 'migration_context' on Instance uuid 051e6c4e-3d10-4b43-9099-7abffd84d0d9 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Ensure instance console log exists: /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Updating instance_info_cache with network_info: [{"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Releasing lock "refresh_cache-63f69337-7ae4-4125-a560-f6cbcb2298d4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Instance network_info: |[{"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] Acquired lock "refresh_cache-63f69337-7ae4-4125-a560-f6cbcb2298d4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.neutron [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Refreshing network info cache for port f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Start _get_guest_xml network_info=[{"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1168002149',display_name='tempest-VolumesNegativeTest-instance-1168002149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1168002149',id=7,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51c1b992977a479883e445330b3d0d97',ramdisk_id='',reservation_id='r-r8pnav0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2050412996',owner_user_name='tempest-VolumesNegativeTest-2050412996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:57Z,user_data=None,user_id='e8adc8b289e548a5ac16b6356753d6dc',uuid=63f69337-7ae4-4125-a560-f6cbcb2298d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Converting VIF {"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1e3287f-407f-49f2-8d91-881e31471ee9,network=Network(b668ec64-0cea-4c5b-b1c5-438d02e373be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e3287f-40') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lazy-loading 'pci_devices' on Instance uuid 63f69337-7ae4-4125-a560-f6cbcb2298d4 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Updating instance_info_cache with network_info: [{"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:08:01 user nova-compute[71507]: INFO nova.compute.claims [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Claim successful on node user
Apr 13 15:08:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Releasing lock "refresh_cache-051e6c4e-3d10-4b43-9099-7abffd84d0d9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Instance network_info: |[{"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:08:01 user nova-compute[71507]:   <uuid>63f69337-7ae4-4125-a560-f6cbcb2298d4</uuid>
Apr 13 15:08:01 user nova-compute[71507]:   <name>instance-00000007</name>
Apr 13 15:08:01 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:08:01 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:08:01 user nova-compute[71507]:   <metadata>
Apr 13 15:08:01 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:08:01 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:name>tempest-VolumesNegativeTest-instance-1168002149</nova:name>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:08:01</nova:creationTime>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:08:01 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:08:01 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:owner>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:user uuid="e8adc8b289e548a5ac16b6356753d6dc">tempest-VolumesNegativeTest-2050412996-project-member</nova:user>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:project uuid="51c1b992977a479883e445330b3d0d97">tempest-VolumesNegativeTest-2050412996</nova:project>
Apr 13 15:08:01 user nova-compute[71507]:       </nova:owner>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:ports>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:port uuid="f1e3287f-407f-49f2-8d91-881e31471ee9">
Apr 13 15:08:01 user nova-compute[71507]:           <nova:ip type="fixed" address="192.168.233.89" ipVersion="4"/>
Apr 13 15:08:01 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:01 user nova-compute[71507]:       </nova:ports>
Apr 13 15:08:01 user nova-compute[71507]:     </nova:instance>
Apr 13 15:08:01 user nova-compute[71507]:   </metadata>
Apr 13 15:08:01 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:08:01 user nova-compute[71507]:     <system>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="serial">63f69337-7ae4-4125-a560-f6cbcb2298d4</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="uuid">63f69337-7ae4-4125-a560-f6cbcb2298d4</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:08:01 user nova-compute[71507]:     </system>
Apr 13 15:08:01 user nova-compute[71507]:   </sysinfo>
Apr 13 15:08:01 user nova-compute[71507]:   <os>
Apr 13 15:08:01 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:08:01 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:08:01 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:08:01 user nova-compute[71507]:   </os>
Apr 13 15:08:01 user nova-compute[71507]:   <features>
Apr 13 15:08:01 user nova-compute[71507]:     <acpi/>
Apr 13 15:08:01 user nova-compute[71507]:     <apic/>
Apr 13 15:08:01 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:08:01 user nova-compute[71507]:   </features>
Apr 13 15:08:01 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:08:01 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:08:01 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:08:01 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:08:01 user nova-compute[71507]:   </clock>
Apr 13 15:08:01 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:08:01 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:08:01 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:08:01 user nova-compute[71507]:   </cpu>
Apr 13 15:08:01 user nova-compute[71507]:   <devices>
Apr 13 15:08:01 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:08:01 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:08:01 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk"/>
Apr 13 15:08:01 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:08:01 user nova-compute[71507]:     </disk>
Apr 13 15:08:01 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:01 user nova-compute[71507]:       <mac address="fa:16:3e:10:03:4f"/>
Apr 13 15:08:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:01 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:01 user nova-compute[71507]:       <target dev="tapf1e3287f-40"/>
Apr 13 15:08:01 user nova-compute[71507]:     </interface>
Apr 13 15:08:01 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:08:01 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/console.log" append="off"/>
Apr 13 15:08:01 user nova-compute[71507]:     </serial>
Apr 13 15:08:01 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:08:01 user nova-compute[71507]:     <video>
Apr 13 15:08:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:01 user nova-compute[71507]:     </video>
Apr 13 15:08:01 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:08:01 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:08:01 user nova-compute[71507]:     </rng>
Apr 13 15:08:01 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:08:01 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:08:01 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:08:01 user nova-compute[71507]:     </memballoon>
Apr 13 15:08:01 user nova-compute[71507]:   </devices>
Apr 13 15:08:01 user nova-compute[71507]: </domain>
Apr 13 15:08:01 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1168002149',display_name='tempest-VolumesNegativeTest-instance-1168002149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1168002149',id=7,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51c1b992977a479883e445330b3d0d97',ramdisk_id='',reservation_id='r-r8pnav0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2050412996',owner_user_name='tempest-VolumesNegativeTest-2050412996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:57Z,user_data=None,user_id='e8adc8b289e548a5ac16b6356753d6dc',uuid=63f69337-7ae4-4125-a560-f6cbcb2298d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Converting VIF {"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1e3287f-407f-49f2-8d91-881e31471ee9,network=Network(b668ec64-0cea-4c5b-b1c5-438d02e373be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e3287f-40') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG os_vif [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1e3287f-407f-49f2-8d91-881e31471ee9,network=Network(b668ec64-0cea-4c5b-b1c5-438d02e373be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e3287f-40') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] Acquired lock "refresh_cache-051e6c4e-3d10-4b43-9099-7abffd84d0d9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.neutron [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Refreshing network info cache for port a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Start _get_guest_xml network_info=[{"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:07:40Z,direct_url=<?>,disk_format='qcow2',id=1b4e800e-2bfa-417d-a618-befe946371e7,min_disk=0,min_ram=0,name='',owner='36848ba7103d4692b57a32caa8755205',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:07:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'image_id': '1b4e800e-2bfa-417d-a618-befe946371e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1e3287f-40, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1e3287f-40, col_values=(('external_ids', {'iface-id': 'f1e3287f-407f-49f2-8d91-881e31471ee9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:03:4f', 'vm-uuid': '63f69337-7ae4-4125-a560-f6cbcb2298d4'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:01 user nova-compute[71507]: INFO os_vif [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1e3287f-407f-49f2-8d91-881e31471ee9,network=Network(b668ec64-0cea-4c5b-b1c5-438d02e373be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e3287f-40')
Apr 13 15:08:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:07:40Z,direct_url=<?>,disk_format='qcow2',id=1b4e800e-2bfa-417d-a618-befe946371e7,min_disk=0,min_ram=0,name='',owner='36848ba7103d4692b57a32caa8755205',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:07:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-147617088',display_name='tempest-AttachSCSIVolumeTestJSON-server-147617088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-147617088',id=6,image_ref='1b4e800e-2bfa-417d-a618-befe946371e7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdE6pt2CSkI/kEMmDhNZ34i6Ws4BJ7Wxj9caFRRNEIYDhqeJqqwyQIDLqWtH2pzCVO74K73+FxMAYZGQKcysukCtq7qljnX22uMPUb/pbYlx+SVYyeT77SFJp2ybY8vxQ==',key_name='tempest-keypair-815100895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89fbef55fb3c43d69af48208d28c87f0',ramdisk_id='',reservation_id='r-eddvxk1i',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1b4e800e-2bfa-417d-a618-befe946371e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-264698011',owner_user_name='tempest-AttachSCSIVolumeTestJSON-264698011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6747b03238c481d836caaf583f20a16',uuid=051e6c4e-3d10-4b43-9099-7abffd84d0d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Converting VIF {"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:68:92,bridge_name='br-int',has_traffic_filtering=True,id=a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f,network=Network(c4a62646-4713-4fec-aef2-21b4c00c534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33a9384-ad') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lazy-loading 'pci_devices' on Instance uuid 051e6c4e-3d10-4b43-9099-7abffd84d0d9 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:08:01 user nova-compute[71507]:   <uuid>051e6c4e-3d10-4b43-9099-7abffd84d0d9</uuid>
Apr 13 15:08:01 user nova-compute[71507]:   <name>instance-00000006</name>
Apr 13 15:08:01 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:08:01 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:08:01 user nova-compute[71507]:   <metadata>
Apr 13 15:08:01 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:08:01 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-147617088</nova:name>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:08:01</nova:creationTime>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:08:01 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:08:01 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:owner>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:user uuid="f6747b03238c481d836caaf583f20a16">tempest-AttachSCSIVolumeTestJSON-264698011-project-member</nova:user>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:project uuid="89fbef55fb3c43d69af48208d28c87f0">tempest-AttachSCSIVolumeTestJSON-264698011</nova:project>
Apr 13 15:08:01 user nova-compute[71507]:       </nova:owner>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:root type="image" uuid="1b4e800e-2bfa-417d-a618-befe946371e7"/>
Apr 13 15:08:01 user nova-compute[71507]:       <nova:ports>
Apr 13 15:08:01 user nova-compute[71507]:         <nova:port uuid="a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f">
Apr 13 15:08:01 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:08:01 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:01 user nova-compute[71507]:       </nova:ports>
Apr 13 15:08:01 user nova-compute[71507]:     </nova:instance>
Apr 13 15:08:01 user nova-compute[71507]:   </metadata>
Apr 13 15:08:01 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:08:01 user nova-compute[71507]:     <system>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="serial">051e6c4e-3d10-4b43-9099-7abffd84d0d9</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="uuid">051e6c4e-3d10-4b43-9099-7abffd84d0d9</entry>
Apr 13 15:08:01 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:08:01 user nova-compute[71507]:     </system>
Apr 13 15:08:01 user nova-compute[71507]:   </sysinfo>
Apr 13 15:08:01 user nova-compute[71507]:   <os>
Apr 13 15:08:01 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:08:01 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:08:01 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:08:01 user nova-compute[71507]:   </os>
Apr 13 15:08:01 user nova-compute[71507]:   <features>
Apr 13 15:08:01 user nova-compute[71507]:     <acpi/>
Apr 13 15:08:01 user nova-compute[71507]:     <apic/>
Apr 13 15:08:01 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:08:01 user nova-compute[71507]:   </features>
Apr 13 15:08:01 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:08:01 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:08:01 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:08:01 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:08:01 user nova-compute[71507]:   </clock>
Apr 13 15:08:01 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:08:01 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:08:01 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:08:01 user nova-compute[71507]:   </cpu>
Apr 13 15:08:01 user nova-compute[71507]:   <devices>
Apr 13 15:08:01 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:08:01 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:08:01 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk"/>
Apr 13 15:08:01 user nova-compute[71507]:       <target dev="sda" bus="scsi"/>
Apr 13 15:08:01 user nova-compute[71507]:       <address type="drive" controller="0" unit="0"/>
Apr 13 15:08:01 user nova-compute[71507]:     </disk>
Apr 13 15:08:01 user nova-compute[71507]:     <disk type="file" device="cdrom">
Apr 13 15:08:01 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 15:08:01 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk.config"/>
Apr 13 15:08:01 user nova-compute[71507]:       <target dev="sdb" bus="scsi"/>
Apr 13 15:08:01 user nova-compute[71507]:       <address type="drive" controller="0" unit="1"/>
Apr 13 15:08:01 user nova-compute[71507]:     </disk>
Apr 13 15:08:01 user nova-compute[71507]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 13 15:08:01 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:01 user nova-compute[71507]:       <mac address="fa:16:3e:93:68:92"/>
Apr 13 15:08:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:01 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:01 user nova-compute[71507]:       <target dev="tapa33a9384-ad"/>
Apr 13 15:08:01 user nova-compute[71507]:     </interface>
Apr 13 15:08:01 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:08:01 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/console.log" append="off"/>
Apr 13 15:08:01 user nova-compute[71507]:     </serial>
Apr 13 15:08:01 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:08:01 user nova-compute[71507]:     <video>
Apr 13 15:08:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:01 user nova-compute[71507]:     </video>
Apr 13 15:08:01 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:08:01 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:08:01 user nova-compute[71507]:     </rng>
Apr 13 15:08:01 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:08:01 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:08:01 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:08:01 user nova-compute[71507]:     </memballoon>
Apr 13 15:08:01 user nova-compute[71507]:   </devices>
Apr 13 15:08:01 user nova-compute[71507]: </domain>
Apr 13 15:08:01 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-147617088',display_name='tempest-AttachSCSIVolumeTestJSON-server-147617088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-147617088',id=6,image_ref='1b4e800e-2bfa-417d-a618-befe946371e7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdE6pt2CSkI/kEMmDhNZ34i6Ws4BJ7Wxj9caFRRNEIYDhqeJqqwyQIDLqWtH2pzCVO74K73+FxMAYZGQKcysukCtq7qljnX22uMPUb/pbYlx+SVYyeT77SFJp2ybY8vxQ==',key_name='tempest-keypair-815100895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89fbef55fb3c43d69af48208d28c87f0',ramdisk_id='',reservation_id='r-eddvxk1i',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1b4e800e-2bfa-417d-a618-befe946371e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-264698011',owner_user_name='tempest-AttachSCSIVolumeTestJSON-264698011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6747b03238c481d836caaf583f20a16',uuid=051e6c4e-3d10-4b43-9099-7abffd84d0d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Converting VIF {"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:68:92,bridge_name='br-int',has_traffic_filtering=True,id=a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f,network=Network(c4a62646-4713-4fec-aef2-21b4c00c534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33a9384-ad') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG os_vif [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:68:92,bridge_name='br-int',has_traffic_filtering=True,id=a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f,network=Network(c4a62646-4713-4fec-aef2-21b4c00c534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33a9384-ad') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa33a9384-ad, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa33a9384-ad, col_values=(('external_ids', {'iface-id': 'a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:68:92', 'vm-uuid': '051e6c4e-3d10-4b43-9099-7abffd84d0d9'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:01 user nova-compute[71507]: INFO os_vif [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:68:92,bridge_name='br-int',has_traffic_filtering=True,id=a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f,network=Network(c4a62646-4713-4fec-aef2-21b4c00c534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33a9384-ad')
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] No VIF found with MAC fa:16:3e:10:03:4f, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] No BDM found with device name sda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] No VIF found with MAC fa:16:3e:93:68:92, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:08:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Using config drive
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:08:01 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.953s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:08:02 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.policy [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54b07929cf2c404ab10ce944437e9e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7b81912360422a8413f8760b0cf7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Updated VIF entry in instance network info cache for port a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Updating instance_info_cache with network_info: [{"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f2117fd5-0c6b-4a85-9a9e-5b8d44d72a6f req-97588bb2-b11e-4cf0-8206-b75369614d70 service nova] Releasing lock "refresh_cache-051e6c4e-3d10-4b43-9099-7abffd84d0d9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:08:02 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Creating image(s)
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "/opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "/opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "/opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.208s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Updated VIF entry in instance network info cache for port f1e3287f-407f-49f2-8d91-881e31471ee9. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Updating instance_info_cache with network_info: [{"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk 1073741824" returned: 0 in 0.192s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-53f8feb7-a1c5-4830-9fca-d12363b79168 req-87cdb2ff-ba0a-4f61-b995-c12293253483 service nova] Releasing lock "refresh_cache-63f69337-7ae4-4125-a560-f6cbcb2298d4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:03 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Creating config drive at /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk.config
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2c6d4jrz {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.207s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2c6d4jrz" returned: 0 in 0.083s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Cannot resize image /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG nova.objects.instance [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'migration_context' on Instance uuid 1be0a3f9-0dae-4739-9f1e-0bb416a97719 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Ensure instance console log exists: /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received event network-vif-plugged-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] Acquiring lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] No waiting events found dispatching network-vif-plugged-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:03 user nova-compute[71507]: WARNING nova.compute.manager [req-6adc3e88-d9e9-4394-afe8-ada603faa451 req-ef8d7f1f-8105-4298-a496-f6a894546b4d service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received unexpected event network-vif-plugged-f1e3287f-407f-49f2-8d91-881e31471ee9 for instance with vm_state building and task_state spawning.
Apr 13 15:08:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:08:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.010s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:08:04 user nova-compute[71507]: INFO nova.compute.claims [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Claim successful on node user
Apr 13 15:08:04 user nova-compute[71507]: DEBUG nova.network.neutron [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Successfully created port: daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:08:04 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:08:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:08:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.policy [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2141a10d4f543fdaab261486c7e7221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27787b48c024464091785f8308d8733e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:08:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Creating image(s)
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "/opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "/opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "/opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Successfully updated port: daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquired lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received event network-changed-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Refreshing instance network info cache due to event network-changed-daee05dc-ae07-4d68-94f3-7c2ee8039327. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] Acquiring lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received event network-vif-plugged-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Acquiring lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] No waiting events found dispatching network-vif-plugged-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:05 user nova-compute[71507]: WARNING nova.compute.manager [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received unexpected event network-vif-plugged-f1e3287f-407f-49f2-8d91-881e31471ee9 for instance with vm_state building and task_state spawning.
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received event network-vif-plugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] No waiting events found dispatching network-vif-plugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:05 user nova-compute[71507]: WARNING nova.compute.manager [req-f85d6641-6bda-42e2-ae99-c633301589ed req-c7002d73-4619-4bd1-89fa-3894596f99d5 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received unexpected event network-vif-plugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance with vm_state building and task_state spawning.
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.297s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk 1073741824" returned: 0 in 0.089s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.168s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:08:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Cannot resize image /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lazy-loading 'migration_context' on Instance uuid 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Ensure instance console log exists: /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.network.neutron [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Updating instance_info_cache with network_info: [{"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Releasing lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Instance network_info: |[{"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] Acquired lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.network.neutron [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Refreshing network info cache for port daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Start _get_guest_xml network_info=[{"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:08:06 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:06 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1268328026',display_name='tempest-VolumesAdminNegativeTest-server-1268328026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1268328026',id=8,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7UiZBBPqbMTDNeH6e75E+1q+0ruGAE6pDAnPOoJW7nq6PcivT2tcES9p9mrLu8hWYaw2+Sm3p5lwGbApOi6N4MWBvGgfhOCip/2hL91LC4ATNbe75oeKHbSqHKlX+mxA==',key_name='tempest-keypair-38678878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7b81912360422a8413f8760b0cf7e1',ramdisk_id='',reservation_id='r-gq0fle0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-721367972',owner_user_name='tempest-VolumesAdminNegativeTest-721367972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b07929cf2c404ab10ce944437e9e97',uuid=1be0a3f9-0dae-4739-9f1e-0bb416a97719,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converting VIF {"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:11:e1,bridge_name='br-int',has_traffic_filtering=True,id=daee05dc-ae07-4d68-94f3-7c2ee8039327,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaee05dc-ae') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.objects.instance [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'pci_devices' on Instance uuid 1be0a3f9-0dae-4739-9f1e-0bb416a97719 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:08:06 user nova-compute[71507]:   <uuid>1be0a3f9-0dae-4739-9f1e-0bb416a97719</uuid>
Apr 13 15:08:06 user nova-compute[71507]:   <name>instance-00000008</name>
Apr 13 15:08:06 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:08:06 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:08:06 user nova-compute[71507]:   <metadata>
Apr 13 15:08:06 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:08:06 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:08:06 user nova-compute[71507]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1268328026</nova:name>
Apr 13 15:08:06 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:08:06</nova:creationTime>
Apr 13 15:08:06 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:08:06 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:08:06 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:08:06 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:08:06 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:08:06 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:08:06 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:08:06 user nova-compute[71507]:       <nova:owner>
Apr 13 15:08:06 user nova-compute[71507]:         <nova:user uuid="54b07929cf2c404ab10ce944437e9e97">tempest-VolumesAdminNegativeTest-721367972-project-member</nova:user>
Apr 13 15:08:06 user nova-compute[71507]:         <nova:project uuid="8f7b81912360422a8413f8760b0cf7e1">tempest-VolumesAdminNegativeTest-721367972</nova:project>
Apr 13 15:08:06 user nova-compute[71507]:       </nova:owner>
Apr 13 15:08:06 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:08:06 user nova-compute[71507]:       <nova:ports>
Apr 13 15:08:06 user nova-compute[71507]:         <nova:port uuid="daee05dc-ae07-4d68-94f3-7c2ee8039327">
Apr 13 15:08:06 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 15:08:06 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:06 user nova-compute[71507]:       </nova:ports>
Apr 13 15:08:06 user nova-compute[71507]:     </nova:instance>
Apr 13 15:08:06 user nova-compute[71507]:   </metadata>
Apr 13 15:08:06 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:08:06 user nova-compute[71507]:     <system>
Apr 13 15:08:06 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:08:06 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:08:06 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:08:06 user nova-compute[71507]:       <entry name="serial">1be0a3f9-0dae-4739-9f1e-0bb416a97719</entry>
Apr 13 15:08:06 user nova-compute[71507]:       <entry name="uuid">1be0a3f9-0dae-4739-9f1e-0bb416a97719</entry>
Apr 13 15:08:06 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:08:06 user nova-compute[71507]:     </system>
Apr 13 15:08:06 user nova-compute[71507]:   </sysinfo>
Apr 13 15:08:06 user nova-compute[71507]:   <os>
Apr 13 15:08:06 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:08:06 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:08:06 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:08:06 user nova-compute[71507]:   </os>
Apr 13 15:08:06 user nova-compute[71507]:   <features>
Apr 13 15:08:06 user nova-compute[71507]:     <acpi/>
Apr 13 15:08:06 user nova-compute[71507]:     <apic/>
Apr 13 15:08:06 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:08:06 user nova-compute[71507]:   </features>
Apr 13 15:08:06 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:08:06 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:08:06 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:08:06 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:08:06 user nova-compute[71507]:   </clock>
Apr 13 15:08:06 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:08:06 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:08:06 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:08:06 user nova-compute[71507]:   </cpu>
Apr 13 15:08:06 user nova-compute[71507]:   <devices>
Apr 13 15:08:06 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:08:06 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:08:06 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk"/>
Apr 13 15:08:06 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:08:06 user nova-compute[71507]:     </disk>
Apr 13 15:08:06 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:06 user nova-compute[71507]:       <mac address="fa:16:3e:3b:11:e1"/>
Apr 13 15:08:06 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:06 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:06 user nova-compute[71507]:       <target dev="tapdaee05dc-ae"/>
Apr 13 15:08:06 user nova-compute[71507]:     </interface>
Apr 13 15:08:06 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:08:06 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/console.log" append="off"/>
Apr 13 15:08:06 user nova-compute[71507]:     </serial>
Apr 13 15:08:06 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:08:06 user nova-compute[71507]:     <video>
Apr 13 15:08:06 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:06 user nova-compute[71507]:     </video>
Apr 13 15:08:06 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:08:06 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:08:06 user nova-compute[71507]:     </rng>
Apr 13 15:08:06 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:08:06 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:08:06 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:08:06 user nova-compute[71507]:     </memballoon>
Apr 13 15:08:06 user nova-compute[71507]:   </devices>
Apr 13 15:08:06 user nova-compute[71507]: </domain>
Apr 13 15:08:06 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1268328026',display_name='tempest-VolumesAdminNegativeTest-server-1268328026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1268328026',id=8,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7UiZBBPqbMTDNeH6e75E+1q+0ruGAE6pDAnPOoJW7nq6PcivT2tcES9p9mrLu8hWYaw2+Sm3p5lwGbApOi6N4MWBvGgfhOCip/2hL91LC4ATNbe75oeKHbSqHKlX+mxA==',key_name='tempest-keypair-38678878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7b81912360422a8413f8760b0cf7e1',ramdisk_id='',reservation_id='r-gq0fle0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-721367972',owner_user_name='tempest-VolumesAdminNegativeTest-721367972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b07929cf2c404ab10ce944437e9e97',uuid=1be0a3f9-0dae-4739-9f1e-0bb416a97719,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converting VIF {"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:11:e1,bridge_name='br-int',has_traffic_filtering=True,id=daee05dc-ae07-4d68-94f3-7c2ee8039327,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaee05dc-ae') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG os_vif [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:11:e1,bridge_name='br-int',has_traffic_filtering=True,id=daee05dc-ae07-4d68-94f3-7c2ee8039327,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaee05dc-ae') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaee05dc-ae, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdaee05dc-ae, col_values=(('external_ids', {'iface-id': 'daee05dc-ae07-4d68-94f3-7c2ee8039327', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:11:e1', 'vm-uuid': '1be0a3f9-0dae-4739-9f1e-0bb416a97719'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:06 user nova-compute[71507]: INFO os_vif [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:11:e1,bridge_name='br-int',has_traffic_filtering=True,id=daee05dc-ae07-4d68-94f3-7c2ee8039327,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaee05dc-ae')
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Successfully created port: 49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:08:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] No VIF found with MAC fa:16:3e:3b:11:e1, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.network.neutron [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Updated VIF entry in instance network info cache for port daee05dc-ae07-4d68-94f3-7c2ee8039327. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.network.neutron [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Updating instance_info_cache with network_info: [{"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-df576384-d6e2-43c0-b6a3-a4c793502db3 req-2727dbde-a628-4777-af41-3b485e039bb6 service nova] Releasing lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398487.2452726, 63f69337-7ae4-4125-a560-f6cbcb2298d4 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] VM Resumed (Lifecycle Event)
Apr 13 15:08:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Instance spawned successfully.
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398487.252318, 63f69337-7ae4-4125-a560-f6cbcb2298d4 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] VM Started (Lifecycle Event)
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Took 10.66 seconds to spawn the instance on the hypervisor.
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Successfully updated port: 49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "refresh_cache-193136fc-e6c3-4e70-b7ab-01ced440c6bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquired lock "refresh_cache-193136fc-e6c3-4e70-b7ab-01ced440c6bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Took 12.30 seconds to build instance.
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received event network-vif-plugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] No waiting events found dispatching network-vif-plugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:07 user nova-compute[71507]: WARNING nova.compute.manager [req-bade3759-dd18-46cf-9885-1fe5638c4981 req-2757086e-d1ec-4c28-960d-f597152d3fa8 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received unexpected event network-vif-plugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance with vm_state building and task_state spawning.
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b244109f-8910-4f8c-8683-2480cc994bb9 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.631s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received event network-changed-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Refreshing instance network info cache due to event network-changed-49eab8a0-3140-4872-b606-e03f2a243e2f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] Acquiring lock "refresh_cache-193136fc-e6c3-4e70-b7ab-01ced440c6bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.claims [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Claim successful on node user
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398487.717517, 051e6c4e-3d10-4b43-9099-7abffd84d0d9 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] VM Resumed (Lifecycle Event)
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Instance spawned successfully.
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398487.7222545, 051e6c4e-3d10-4b43-9099-7abffd84d0d9 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] VM Started (Lifecycle Event)
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Took 9.60 seconds to spawn the instance on the hypervisor.
Apr 13 15:08:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:07 user nova-compute[71507]: INFO nova.compute.manager [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Took 12.60 seconds to build instance.
Apr 13 15:08:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-78b41f42-0a61-479f-b88d-4921c0d9298f tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.885s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Updating instance_info_cache with network_info: [{"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Releasing lock "refresh_cache-193136fc-e6c3-4e70-b7ab-01ced440c6bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Instance network_info: |[{"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] Acquired lock "refresh_cache-193136fc-e6c3-4e70-b7ab-01ced440c6bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Refreshing network info cache for port 49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Start _get_guest_xml network_info=[{"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:08:08 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:08 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-955792819',display_name='tempest-TestVolumeSwap-server-955792819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-955792819',id=9,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxaPFHAbqgKO/COFA+DY9rzW2J06VevHnbo6RHC30lfgxcW4Tr0/A0vkvfKOugPt7bpUnVxbSJNj1OF4CitPIV1KK3jFhN1Gew1EBCLK64eY9o49B6MR8/BFPl6+1JP9Q==',key_name='tempest-keypair-207135700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27787b48c024464091785f8308d8733e',ramdisk_id='',reservation_id='r-rm4mlg63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-927377931',owner_user_name='tempest-TestVolumeSwap-927377931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2141a10d4f543fdaab261486c7e7221',uuid=193136fc-e6c3-4e70-b7ab-01ced440c6bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Converting VIF {"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:39:0d,bridge_name='br-int',has_traffic_filtering=True,id=49eab8a0-3140-4872-b606-e03f2a243e2f,network=Network(e30a4e6a-48e9-4a29-9721-5a01fc24588e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49eab8a0-31') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lazy-loading 'pci_devices' on Instance uuid 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:08:08 user nova-compute[71507]:   <uuid>193136fc-e6c3-4e70-b7ab-01ced440c6bd</uuid>
Apr 13 15:08:08 user nova-compute[71507]:   <name>instance-00000009</name>
Apr 13 15:08:08 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:08:08 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:08:08 user nova-compute[71507]:   <metadata>
Apr 13 15:08:08 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:08:08 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:08:08 user nova-compute[71507]:       <nova:name>tempest-TestVolumeSwap-server-955792819</nova:name>
Apr 13 15:08:08 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:08:08</nova:creationTime>
Apr 13 15:08:08 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:08:08 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:08:08 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:08:08 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:08:08 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:08:08 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:08:08 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:08:08 user nova-compute[71507]:       <nova:owner>
Apr 13 15:08:08 user nova-compute[71507]:         <nova:user uuid="c2141a10d4f543fdaab261486c7e7221">tempest-TestVolumeSwap-927377931-project-member</nova:user>
Apr 13 15:08:08 user nova-compute[71507]:         <nova:project uuid="27787b48c024464091785f8308d8733e">tempest-TestVolumeSwap-927377931</nova:project>
Apr 13 15:08:08 user nova-compute[71507]:       </nova:owner>
Apr 13 15:08:08 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:08:08 user nova-compute[71507]:       <nova:ports>
Apr 13 15:08:08 user nova-compute[71507]:         <nova:port uuid="49eab8a0-3140-4872-b606-e03f2a243e2f">
Apr 13 15:08:08 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 15:08:08 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:08 user nova-compute[71507]:       </nova:ports>
Apr 13 15:08:08 user nova-compute[71507]:     </nova:instance>
Apr 13 15:08:08 user nova-compute[71507]:   </metadata>
Apr 13 15:08:08 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:08:08 user nova-compute[71507]:     <system>
Apr 13 15:08:08 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:08:08 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:08:08 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:08:08 user nova-compute[71507]:       <entry name="serial">193136fc-e6c3-4e70-b7ab-01ced440c6bd</entry>
Apr 13 15:08:08 user nova-compute[71507]:       <entry name="uuid">193136fc-e6c3-4e70-b7ab-01ced440c6bd</entry>
Apr 13 15:08:08 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:08:08 user nova-compute[71507]:     </system>
Apr 13 15:08:08 user nova-compute[71507]:   </sysinfo>
Apr 13 15:08:08 user nova-compute[71507]:   <os>
Apr 13 15:08:08 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:08:08 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:08:08 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:08:08 user nova-compute[71507]:   </os>
Apr 13 15:08:08 user nova-compute[71507]:   <features>
Apr 13 15:08:08 user nova-compute[71507]:     <acpi/>
Apr 13 15:08:08 user nova-compute[71507]:     <apic/>
Apr 13 15:08:08 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:08:08 user nova-compute[71507]:   </features>
Apr 13 15:08:08 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:08:08 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:08:08 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:08:08 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:08:08 user nova-compute[71507]:   </clock>
Apr 13 15:08:08 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:08:08 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:08:08 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:08:08 user nova-compute[71507]:   </cpu>
Apr 13 15:08:08 user nova-compute[71507]:   <devices>
Apr 13 15:08:08 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:08:08 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:08:08 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk"/>
Apr 13 15:08:08 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:08:08 user nova-compute[71507]:     </disk>
Apr 13 15:08:08 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:08 user nova-compute[71507]:       <mac address="fa:16:3e:6e:39:0d"/>
Apr 13 15:08:08 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:08 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:08 user nova-compute[71507]:       <target dev="tap49eab8a0-31"/>
Apr 13 15:08:08 user nova-compute[71507]:     </interface>
Apr 13 15:08:08 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:08:08 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/console.log" append="off"/>
Apr 13 15:08:08 user nova-compute[71507]:     </serial>
Apr 13 15:08:08 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:08:08 user nova-compute[71507]:     <video>
Apr 13 15:08:08 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:08 user nova-compute[71507]:     </video>
Apr 13 15:08:08 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:08:08 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:08:08 user nova-compute[71507]:     </rng>
Apr 13 15:08:08 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:08:08 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:08:08 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:08:08 user nova-compute[71507]:     </memballoon>
Apr 13 15:08:08 user nova-compute[71507]:   </devices>
Apr 13 15:08:08 user nova-compute[71507]: </domain>
Apr 13 15:08:08 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-955792819',display_name='tempest-TestVolumeSwap-server-955792819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-955792819',id=9,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxaPFHAbqgKO/COFA+DY9rzW2J06VevHnbo6RHC30lfgxcW4Tr0/A0vkvfKOugPt7bpUnVxbSJNj1OF4CitPIV1KK3jFhN1Gew1EBCLK64eY9o49B6MR8/BFPl6+1JP9Q==',key_name='tempest-keypair-207135700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27787b48c024464091785f8308d8733e',ramdisk_id='',reservation_id='r-rm4mlg63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-927377931',owner_user_name='tempest-TestVolumeSwap-927377931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2141a10d4f543fdaab261486c7e7221',uuid=193136fc-e6c3-4e70-b7ab-01ced440c6bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Converting VIF {"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:39:0d,bridge_name='br-int',has_traffic_filtering=True,id=49eab8a0-3140-4872-b606-e03f2a243e2f,network=Network(e30a4e6a-48e9-4a29-9721-5a01fc24588e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49eab8a0-31') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG os_vif [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:39:0d,bridge_name='br-int',has_traffic_filtering=True,id=49eab8a0-3140-4872-b606-e03f2a243e2f,network=Network(e30a4e6a-48e9-4a29-9721-5a01fc24588e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49eab8a0-31') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49eab8a0-31, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49eab8a0-31, col_values=(('external_ids', {'iface-id': '49eab8a0-3140-4872-b606-e03f2a243e2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:39:0d', 'vm-uuid': '193136fc-e6c3-4e70-b7ab-01ced440c6bd'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:08 user nova-compute[71507]: INFO os_vif [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:39:0d,bridge_name='br-int',has_traffic_filtering=True,id=49eab8a0-3140-4872-b606-e03f2a243e2f,network=Network(e30a4e6a-48e9-4a29-9721-5a01fc24588e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49eab8a0-31')
Apr 13 15:08:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] No VIF found with MAC fa:16:3e:6e:39:0d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:08:08 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:08:08 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Creating image(s)
Apr 13 15:08:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:08 user nova-compute[71507]: DEBUG nova.policy [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.232s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.253s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk 1073741824" returned: 0 in 0.059s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.212s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received event network-vif-plugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] No waiting events found dispatching network-vif-plugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:09 user nova-compute[71507]: WARNING nova.compute.manager [req-1d788c32-5e99-4f2b-9d72-3cc3a609ccf0 req-ce3af702-4a4b-4734-91e4-b11fdf685fdd service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received unexpected event network-vif-plugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance with vm_state building and task_state spawning.
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Cannot resize image /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'migration_context' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Ensure instance console log exists: /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG nova.network.neutron [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Updated VIF entry in instance network info cache for port 49eab8a0-3140-4872-b606-e03f2a243e2f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG nova.network.neutron [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Updating instance_info_cache with network_info: [{"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9f19e763-72ad-4f0d-8f83-ea8e2de8d880 req-00b0bfd1-48bc-47e6-9da3-d687ed0237d3 service nova] Releasing lock "refresh_cache-193136fc-e6c3-4e70-b7ab-01ced440c6bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:10 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Successfully created port: ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:08:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received event network-vif-plugged-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] No waiting events found dispatching network-vif-plugged-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:10 user nova-compute[71507]: WARNING nova.compute.manager [req-ad4084f8-8e11-414e-a7ca-b8cd81ba7794 req-9d228524-04e0-4d34-a4d4-e54de802870b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received unexpected event network-vif-plugged-49eab8a0-3140-4872-b606-e03f2a243e2f for instance with vm_state building and task_state spawning.
Apr 13 15:08:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398491.2022986, 1be0a3f9-0dae-4739-9f1e-0bb416a97719 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:11 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] VM Resumed (Lifecycle Event)
Apr 13 15:08:11 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Instance spawned successfully.
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:11 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398491.202468, 1be0a3f9-0dae-4739-9f1e-0bb416a97719 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:11 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] VM Started (Lifecycle Event)
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:11 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:11 user nova-compute[71507]: INFO nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Took 8.98 seconds to spawn the instance on the hypervisor.
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:11 user nova-compute[71507]: INFO nova.compute.manager [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Took 10.46 seconds to build instance.
Apr 13 15:08:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-40f925c0-3957-454d-adcf-0f0133143dab tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.627s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Successfully updated port: ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquired lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received event network-vif-plugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] No waiting events found dispatching network-vif-plugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:11 user nova-compute[71507]: WARNING nova.compute.manager [req-5bf44802-7c4a-4a25-a9ad-e35c942c2929 req-e3cab4cd-cfb3-47bc-b57b-5afb7e1e4ac7 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received unexpected event network-vif-plugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance with vm_state active and task_state None.
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updating instance_info_cache with network_info: [{"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Releasing lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Instance network_info: |[{"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Start _get_guest_xml network_info=[{"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:08:12 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:12 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055562483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2055562483',id=10,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A==',key_name='tempest-keypair-1905935028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be23bf27d7ed4f0abf2fdc60ae1edb71',ramdisk_id='',reservation_id='r-wj2y7pak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-227294207',owner_user_name='tempest-TaggedAttachmentsTest-227294207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b59f4d6492a4821a621b18766bf58fa',uuid=95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converting VIF {"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ce8e302f-1f0b-46e0-82ef-9809a6ad81db,network=Network(4f48b4f3-f64b-428b-b729-0d4305647e89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce8e302f-1f') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'pci_devices' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:08:12 user nova-compute[71507]:   <uuid>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</uuid>
Apr 13 15:08:12 user nova-compute[71507]:   <name>instance-0000000a</name>
Apr 13 15:08:12 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:08:12 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:08:12 user nova-compute[71507]:   <metadata>
Apr 13 15:08:12 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:08:12 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:08:12 user nova-compute[71507]:       <nova:name>tempest-device-tagging-server-2055562483</nova:name>
Apr 13 15:08:12 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:08:12</nova:creationTime>
Apr 13 15:08:12 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:08:12 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:08:12 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:08:12 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:08:12 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:08:12 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:08:12 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:08:12 user nova-compute[71507]:       <nova:owner>
Apr 13 15:08:12 user nova-compute[71507]:         <nova:user uuid="5b59f4d6492a4821a621b18766bf58fa">tempest-TaggedAttachmentsTest-227294207-project-member</nova:user>
Apr 13 15:08:12 user nova-compute[71507]:         <nova:project uuid="be23bf27d7ed4f0abf2fdc60ae1edb71">tempest-TaggedAttachmentsTest-227294207</nova:project>
Apr 13 15:08:12 user nova-compute[71507]:       </nova:owner>
Apr 13 15:08:12 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:08:12 user nova-compute[71507]:       <nova:ports>
Apr 13 15:08:12 user nova-compute[71507]:         <nova:port uuid="ce8e302f-1f0b-46e0-82ef-9809a6ad81db">
Apr 13 15:08:12 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:08:12 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:12 user nova-compute[71507]:       </nova:ports>
Apr 13 15:08:12 user nova-compute[71507]:     </nova:instance>
Apr 13 15:08:12 user nova-compute[71507]:   </metadata>
Apr 13 15:08:12 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:08:12 user nova-compute[71507]:     <system>
Apr 13 15:08:12 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:08:12 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:08:12 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:08:12 user nova-compute[71507]:       <entry name="serial">95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:08:12 user nova-compute[71507]:       <entry name="uuid">95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:08:12 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:08:12 user nova-compute[71507]:     </system>
Apr 13 15:08:12 user nova-compute[71507]:   </sysinfo>
Apr 13 15:08:12 user nova-compute[71507]:   <os>
Apr 13 15:08:12 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:08:12 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:08:12 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:08:12 user nova-compute[71507]:   </os>
Apr 13 15:08:12 user nova-compute[71507]:   <features>
Apr 13 15:08:12 user nova-compute[71507]:     <acpi/>
Apr 13 15:08:12 user nova-compute[71507]:     <apic/>
Apr 13 15:08:12 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:08:12 user nova-compute[71507]:   </features>
Apr 13 15:08:12 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:08:12 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:08:12 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:08:12 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:08:12 user nova-compute[71507]:   </clock>
Apr 13 15:08:12 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:08:12 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:08:12 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:08:12 user nova-compute[71507]:   </cpu>
Apr 13 15:08:12 user nova-compute[71507]:   <devices>
Apr 13 15:08:12 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:08:12 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:08:12 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk"/>
Apr 13 15:08:12 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:08:12 user nova-compute[71507]:     </disk>
Apr 13 15:08:12 user nova-compute[71507]:     <disk type="file" device="cdrom">
Apr 13 15:08:12 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 15:08:12 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.config"/>
Apr 13 15:08:12 user nova-compute[71507]:       <target dev="hda" bus="ide"/>
Apr 13 15:08:12 user nova-compute[71507]:     </disk>
Apr 13 15:08:12 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:12 user nova-compute[71507]:       <mac address="fa:16:3e:cd:1d:8a"/>
Apr 13 15:08:12 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:12 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:12 user nova-compute[71507]:       <target dev="tapce8e302f-1f"/>
Apr 13 15:08:12 user nova-compute[71507]:     </interface>
Apr 13 15:08:12 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:08:12 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log" append="off"/>
Apr 13 15:08:12 user nova-compute[71507]:     </serial>
Apr 13 15:08:12 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:08:12 user nova-compute[71507]:     <video>
Apr 13 15:08:12 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:12 user nova-compute[71507]:     </video>
Apr 13 15:08:12 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:08:12 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:08:12 user nova-compute[71507]:     </rng>
Apr 13 15:08:12 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:08:12 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:08:12 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:08:12 user nova-compute[71507]:     </memballoon>
Apr 13 15:08:12 user nova-compute[71507]:   </devices>
Apr 13 15:08:12 user nova-compute[71507]: </domain>
Apr 13 15:08:12 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055562483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2055562483',id=10,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A==',key_name='tempest-keypair-1905935028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be23bf27d7ed4f0abf2fdc60ae1edb71',ramdisk_id='',reservation_id='r-wj2y7pak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-227294207',owner_user_name='tempest-TaggedAttachmentsTest-227294207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b59f4d6492a4821a621b18766bf58fa',uuid=95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converting VIF {"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ce8e302f-1f0b-46e0-82ef-9809a6ad81db,network=Network(4f48b4f3-f64b-428b-b729-0d4305647e89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce8e302f-1f') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG os_vif [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ce8e302f-1f0b-46e0-82ef-9809a6ad81db,network=Network(4f48b4f3-f64b-428b-b729-0d4305647e89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce8e302f-1f') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce8e302f-1f, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce8e302f-1f, col_values=(('external_ids', {'iface-id': 'ce8e302f-1f0b-46e0-82ef-9809a6ad81db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:1d:8a', 'vm-uuid': '95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:12 user nova-compute[71507]: INFO os_vif [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ce8e302f-1f0b-46e0-82ef-9809a6ad81db,network=Network(4f48b4f3-f64b-428b-b729-0d4305647e89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce8e302f-1f')
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] No BDM found with device name hda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] No VIF found with MAC fa:16:3e:cd:1d:8a, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:08:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Using config drive
Apr 13 15:08:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Creating config drive at /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.config
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2nwtavst {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2nwtavst" returned: 0 in 0.070s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] There are 0 instances to clean {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances with incomplete migration  {{(pid=71507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398492.8433726, 193136fc-e6c3-4e70-b7ab-01ced440c6bd => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] VM Resumed (Lifecycle Event)
Apr 13 15:08:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Instance spawned successfully.
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received event network-vif-plugged-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] No waiting events found dispatching network-vif-plugged-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:12 user nova-compute[71507]: WARNING nova.compute.manager [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received unexpected event network-vif-plugged-49eab8a0-3140-4872-b606-e03f2a243e2f for instance with vm_state building and task_state spawning.
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-changed-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Refreshing instance network info cache due to event network-changed-ce8e302f-1f0b-46e0-82ef-9809a6ad81db. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Acquiring lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Acquired lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.network.neutron [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Refreshing network info cache for port ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:12 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398492.8438475, 193136fc-e6c3-4e70-b7ab-01ced440c6bd => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] VM Started (Lifecycle Event)
Apr 13 15:08:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:13 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:13 user nova-compute[71507]: INFO nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Took 7.83 seconds to spawn the instance on the hypervisor.
Apr 13 15:08:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:13 user nova-compute[71507]: INFO nova.compute.manager [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Took 9.12 seconds to build instance.
Apr 13 15:08:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d26cd4b4-acc6-48d1-a76c-aa805a0bd4a4 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.317s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:13 user nova-compute[71507]: DEBUG nova.network.neutron [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updated VIF entry in instance network info cache for port ce8e302f-1f0b-46e0-82ef-9809a6ad81db. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:08:13 user nova-compute[71507]: DEBUG nova.network.neutron [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updating instance_info_cache with network_info: [{"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a3e4992e-fbc3-4b9b-8c22-ffdd723498e4 req-bec5bf2b-b96a-4ea3-874f-9de088a7549b service nova] Releasing lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:14 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-plugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] No waiting events found dispatching network-vif-plugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:15 user nova-compute[71507]: WARNING nova.compute.manager [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received unexpected event network-vif-plugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance with vm_state building and task_state spawning.
Apr 13 15:08:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-plugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] No waiting events found dispatching network-vif-plugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:15 user nova-compute[71507]: WARNING nova.compute.manager [req-a4cafc30-bd90-4378-9706-6361eb9d6eee req-66857ea8-07de-4f60-ad06-81fa1f6480a7 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received unexpected event network-vif-plugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance with vm_state building and task_state spawning.
Apr 13 15:08:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398497.2649894, 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:17 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] VM Resumed (Lifecycle Event)
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:08:17 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Instance spawned successfully.
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:17 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398497.2669866, 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:17 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] VM Started (Lifecycle Event)
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:17 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:17 user nova-compute[71507]: INFO nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Took 8.61 seconds to spawn the instance on the hypervisor.
Apr 13 15:08:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:17 user nova-compute[71507]: INFO nova.compute.manager [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Took 9.93 seconds to build instance.
Apr 13 15:08:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9639913e-fe99-42c4-896f-784e49ee996f tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.094s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:22 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:22 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7577MB free_disk=26.539962768554688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 654608ee-5897-429a-b19c-6845d4e84818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing inventories for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating ProviderTree inventory for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing aggregate associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, aggregates: None {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 15:08:22 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing trait associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 15:08:23 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:08:23 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:08:23 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:08:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.078s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-58a0788e-df82-4c1e-97dd-1d246048afc5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-58a0788e-df82-4c1e-97dd-1d246048afc5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid 58a0788e-df82-4c1e-97dd-1d246048afc5 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Updating instance_info_cache with network_info: [{"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-58a0788e-df82-4c1e-97dd-1d246048afc5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:08:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:08:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:25 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:08:25 user nova-compute[71507]: INFO nova.compute.claims [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Claim successful on node user
Apr 13 15:08:26 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:08:26 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:08:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:08:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:08:26 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:08:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:08:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:08:26 user nova-compute[71507]: INFO nova.virt.block_device [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Booting with volume a098f171-2580-4930-a4a3-79cac86e30d6 at /dev/vda
Apr 13 15:08:26 user nova-compute[71507]: DEBUG os_brick.utils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:08:26 user nova-compute[71507]: INFO oslo.privsep.daemon [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpfpojovs1/privsep.sock']
Apr 13 15:08:26 user nova-compute[71507]: DEBUG nova.policy [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40c18c8a515b457088a9901fbc86629f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd530eb6a4bf04f468299323520f56d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:08:26 user sudo[81894]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpfpojovs1/privsep.sock
Apr 13 15:08:26 user sudo[81894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 15:08:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:27 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully created port: 6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:08:28 user sudo[81894]: pam_unix(sudo:session): session closed for user root
Apr 13 15:08:28 user nova-compute[71507]: INFO oslo.privsep.daemon [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Spawned new privsep daemon via rootwrap
Apr 13 15:08:28 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 15:08:28 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 15:08:28 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 13 15:08:28 user nova-compute[71507]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81901
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9165cfd8-d660-4a53-9c87-7f2c54aa4015]: (2,) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully created port: 0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c98a17-a3c1-43d9-9aa2-b617dac14c36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:28 user nova-compute[71507]: WARNING os_brick.initiator.connectors.nvmeof [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a28d197-980b-4570-83d5-6076b975891b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69f1ff1-b191-493b-bb42-c3d815a45af5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c1e236-97b2-4f98-8848-dd28298a1890]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:08:28 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:08:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ded436-4b77-418e-8081-443d4476cecf]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG os_brick.utils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] <== get_connector_properties: return (2126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:08:28 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating existing volume attachment record: 1b7bf14a-9c9b-4668-9b24-db6f193d1fb8 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:08:29 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully created port: a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:08:29 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully created port: 989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:08:30 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully created port: c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:08:31 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully updated port: 6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-changed-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing instance network info cache due to event network-changed-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] Acquiring lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] Acquired lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:31 user nova-compute[71507]: DEBUG nova.network.neutron [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing network info cache for port 6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:32 user nova-compute[71507]: DEBUG nova.network.neutron [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:32 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully updated port: f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:32 user nova-compute[71507]: DEBUG nova.network.neutron [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3facb4de-bad8-4ab2-9cbb-e48351ed49a1 req-712f4f88-5518-42ed-9152-7a75dbe01bff service nova] Releasing lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-changed-f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing instance network info cache due to event network-changed-f81f8894-95c8-443a-92e6-0bbc31c8e87c. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] Acquiring lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] Acquired lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG nova.network.neutron [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing network info cache for port f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:34 user nova-compute[71507]: INFO nova.virt.block_device [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Booting with volume 3296f7da-aff3-46a3-8567-6d8fd71c9ece at /dev/vdb
Apr 13 15:08:34 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully updated port: d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG nova.network.neutron [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG os_brick.utils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe5c519-9281-4054-a47a-951ed7feb43b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8094cd9-ebec-4258-8624-1cd71ec38720]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[678549a0-7adc-42f0-843d-71fcf2707d12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d70d8b-7e04-4e3f-929d-8392313a9cad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:08:34 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc2020c-a6bf-4eff-beeb-08baa56f659f]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG os_brick.utils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating existing volume attachment record: 7bbd539a-44ac-4c84-8811-ed8b21aa2080 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG nova.network.neutron [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-25e3413b-8f9d-430e-a489-6e10ec7e8a22 req-15177f60-f6f2-49a5-aab9-6c3af64281ed service nova] Releasing lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:34 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully updated port: 0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully updated port: a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-changed-d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing instance network info cache due to event network-changed-d2e29dc8-81b4-4712-9be4-e97c7f116aed. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Acquiring lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Acquired lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing network info cache for port d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully updated port: 989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Releasing lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-changed-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing instance network info cache due to event network-changed-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Acquiring lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Acquired lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing network info cache for port 0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Successfully updated port: c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Releasing lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-changed-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing instance network info cache due to event network-changed-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Acquiring lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Acquired lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing network info cache for port a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-changed-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing instance network info cache due to event network-changed-989ec3b8-1a00-47b5-9a07-71f33cfb6c69. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Acquiring lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:38 user nova-compute[71507]: DEBUG nova.network.neutron [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73e54b81-bdcc-4c56-9f0d-f99d840958c1 req-6484d98b-e12b-4970-8678-7d1aff8b4e3f service nova] Releasing lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquired lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:38 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:08:38 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:38 user nova-compute[71507]: INFO nova.virt.block_device [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Booting with volume a62eeb8c-6d75-4da8-8262-5afab3861b5a at /dev/vdc
Apr 13 15:08:39 user nova-compute[71507]: DEBUG os_brick.utils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0c957c-7b45-4d11-98d6-97f6b56b4639]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aecdbd6-2167-4dfe-a220-d65d8f4a6e2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc4808-3bb0-4b01-8735-484a66e2e4fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[488fa5b5-a0f4-44c7-88df-b5637ad3804b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:08:39 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:08:39 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5896d2-5ba0-4d89-b05c-747b51c569f8]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG os_brick.utils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating existing volume attachment record: 8aaf872c-39cf-4ced-9043-fb4b834c084b {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:08:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [{"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Releasing lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance network_info: |[{"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Acquired lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG nova.network.neutron [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing network info cache for port 989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG nova.network.neutron [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updated VIF entry in instance network info cache for port 989ec3b8-1a00-47b5-9a07-71f33cfb6c69. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG nova.network.neutron [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [{"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Releasing lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-changed-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing instance network info cache due to event network-changed-c97ac499-c8fa-412e-9452-c6f80e69c879. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Acquiring lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Acquired lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:41 user nova-compute[71507]: DEBUG nova.network.neutron [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing network info cache for port c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:42 user nova-compute[71507]: DEBUG nova.network.neutron [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updated VIF entry in instance network info cache for port c97ac499-c8fa-412e-9452-c6f80e69c879. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:08:42 user nova-compute[71507]: DEBUG nova.network.neutron [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [{"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4dda981c-182b-4595-b4a8-66b8ec935940 req-bd451e1d-63a1-45ea-9d6e-261ee8a2380a service nova] Releasing lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:08:43 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Creating image(s)
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Ensure instance console log exists: /opt/stack/data/nova/instances/e84c85a8-b97d-44ac-b0b3-f898860f5944/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Start _get_guest_xml network_info=[{"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLgEJWYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e84c85a8-b97d-44ac-b0b3-f898860f5944', 'attached_at': '', 'detached_at': '', 'volume_id': 'a098f171-2580-4930-a4a3-79cac86e30d6', 'serial': 'a098f171-2580-4930-a4a3-79cac86e30d6'}, 'attachment_id': '1b7bf14a-9c9b-4668-9b24-db6f193d1fb8', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFdBQSWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e84c85a8-b97d-44ac-b0b3-f898860f5944', 'attached_at': '', 'detached_at': '', 'volume_id': '3296f7da-aff3-46a3-8567-6d8fd71c9ece', 'serial': '3296f7da-aff3-46a3-8567-6d8fd71c9ece'}, 'attachment_id': '7bbd539a-44ac-4c84-8811-ed8b21aa2080', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNJrdnRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e84c85a8-b97d-44ac-b0b3-f898860f5944', 'attached_at': '', 'detached_at': '', 'volume_id': 'a62eeb8c-6d75-4da8-8262-5afab3861b5a', 'serial': 'a62eeb8c-6d75-4da8-8262-5afab3861b5a'}, 'attachment_id': '8aaf872c-39cf-4ced-9043-fb4b834c084b', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:08:43 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:43 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG os_brick.initiator.connector [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Factory for ISCSI on None {{(pid=71507) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLgEJWYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:08:43 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:08:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:08:43 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:08:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:08:43 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdf3c5d-b85b-4bf3-9cae-0f7133c63a47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:08:43 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bae304-df1d-4679-add4-7cd66307eae8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6] added
Apr 13 15:08:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8110e6b-f79d-45fe-832d-5857126cb6de]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a77092-d6e7-4d0a-8df6-e10168f9a277]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLgEJWYl {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLgEJWYl" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ebbe37-0d94-4e5a-9974-23b29ac09a32]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jLgEJWYl'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c71329b-2c80-4cb2-82e8-4550816599e4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[963c9cde-8b1d-4c6f-9e13-db374d8ec0f0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:08:44 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:08:44 user nova-compute[71507]:  {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:08:44 user nova-compute[71507]: WARNING os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 15:08:44 user nova-compute[71507]: 
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17bf8e4-a4bc-411d-8aac-ffcf65625ec6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6, portal: 172.16.0.220,3260]
Apr 13 15:08:44 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6, portal: 172.16.0.220,3260] successful.
Apr 13 15:08:44 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e24c5ec-eb8c-45fa-9535-ffdbb018cb2a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[327549fa-2917-4759-9d31-f5d9ba99be20]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:44 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:44 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aefbe3e-63a5-4f3a-8a7f-c8280a53982d]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:08:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLgEJWYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23265343139323066', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265343139323066', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFdBQSWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:08:45 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:08:45 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:08:45 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c5e5cd-4819-4bc8-95ec-e0af343d850d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:08:45 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a96dc5-c1d3-4e9c-9b80-899b751bffa4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece] added
Apr 13 15:08:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e003032-367e-4252-89fb-9848fdee0ca1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6552cb2-7921-4288-b12b-d8d293a13895]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFdBQSWb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFdBQSWb" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4432d97-853c-4c8f-9ae9-f013f25da600]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFdBQSWb'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9a592e-da48-438b-abea-4cc094dde5e8]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34c90b4-c657-4fda-a2a6-6cf3027edd5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd06a61-2513-450b-b91a-f508c9c85f54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece, portal: 172.16.0.220,3260]
Apr 13 15:08:45 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece, portal: 172.16.0.220,3260] successful.
Apr 13 15:08:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b0030-d8c3-442c-b7bb-c5882eeb3e50]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f095099a-3499-473b-aa79-a2787fcc87a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:45 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:45 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8af500-e2e3-455c-a015-5869703a33f3]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:08:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFdBQSWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26136373332313766', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136373332313766', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNJrdnRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:08:46 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:08:46 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:08:46 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97907f7-92ed-42b0-8eba-05c9d860eb7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:08:46 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6b02bd-27da-4ae7-ba5e-0f628f8f885a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a] added
Apr 13 15:08:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6822ee1-c1fe-4c2e-8a9f-ee5f4e59be2a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb37f97-9344-4291-8ac9-bde55827a032]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bNJrdnRe {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bNJrdnRe" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[75798945-6da8-4f62-ae3d-b0dcce0c151a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bNJrdnRe'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6bc69a-83ed-40da-b031-049082ddf09d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3388b2-8443-42f6-b910-fc104941aa73]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:46 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:46 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[804617b3-6ba9-42f4-beaf-0d4cdd416e9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a, portal: 172.16.0.220,3260]
Apr 13 15:08:46 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a, portal: 172.16.0.220,3260] successful.
Apr 13 15:08:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3093637c-f686-4a5a-87c6-68782cbe4698]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[677de7c1-3bee-49d9-a250-63a92bfec720]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:46 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:46 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:08:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:46 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:46 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:08:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3ee505-48be-4be4-bcd4-18b9c461aac2]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:08:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNJrdnRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:08:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:47 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:08:47 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26330303336643732', 'path': '/dev/sdd'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:08:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330303336643732', 'path': '/dev/sdd'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6c:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4ead67-98a8-4a15-b31e-6ed9a0d075c5,network=Network(7a95cb70-f248-48c3-bcaf-29e420112188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4ead67-98') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:39:4f,bridge_name='br-int',has_traffic_filtering=True,id=f81f8894-95c8-443a-92e6-0bbc31c8e87c,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81f8894-95') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2e29dc8-81b4-4712-9be4-e97c7f116aed,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2e29dc8-81') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=0bbdcb7f-44fc-4144-9dcc-b82be1a036fd,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbdcb7f-44') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5f:b6,bridge_name='br-int',has_traffic_filtering=True,id=a1f1b21e-12c3-4310-9ef0-791f4d09fc5f,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f1b21e-12') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=989ec3b8-1a00-47b5-9a07-71f33cfb6c69,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989ec3b8-1a') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:15:e7,bridge_name='br-int',has_traffic_filtering=True,id=c97ac499-c8fa-412e-9452-c6f80e69c879,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc97ac499-c8') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lazy-loading 'pci_devices' on Instance uuid e84c85a8-b97d-44ac-b0b3-f898860f5944 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:08:48 user nova-compute[71507]:   <uuid>e84c85a8-b97d-44ac-b0b3-f898860f5944</uuid>
Apr 13 15:08:48 user nova-compute[71507]:   <name>instance-0000000b</name>
Apr 13 15:08:48 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:08:48 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:08:48 user nova-compute[71507]:   <metadata>
Apr 13 15:08:48 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:08:48 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:08:48 user nova-compute[71507]:       <nova:name>tempest-device-tagging-server-1904364306</nova:name>
Apr 13 15:08:48 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:08:43</nova:creationTime>
Apr 13 15:08:48 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:08:48 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:08:48 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:08:48 user nova-compute[71507]:       <nova:owner>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:user uuid="40c18c8a515b457088a9901fbc86629f">tempest-TaggedBootDevicesTest-1120084057-project-member</nova:user>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:project uuid="d530eb6a4bf04f468299323520f56d1d">tempest-TaggedBootDevicesTest-1120084057</nova:project>
Apr 13 15:08:48 user nova-compute[71507]:       </nova:owner>
Apr 13 15:08:48 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:08:48 user nova-compute[71507]:       <nova:ports>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:port uuid="6e4ead67-98a8-4a15-b31e-6ed9a0d075c5">
Apr 13 15:08:48 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 15:08:48 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:port uuid="f81f8894-95c8-443a-92e6-0bbc31c8e87c">
Apr 13 15:08:48 user nova-compute[71507]:           <nova:ip type="fixed" address="10.1.1.211" ipVersion="4"/>
Apr 13 15:08:48 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:port uuid="d2e29dc8-81b4-4712-9be4-e97c7f116aed">
Apr 13 15:08:48 user nova-compute[71507]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Apr 13 15:08:48 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:port uuid="0bbdcb7f-44fc-4144-9dcc-b82be1a036fd">
Apr 13 15:08:48 user nova-compute[71507]:           <nova:ip type="fixed" address="10.1.1.5" ipVersion="4"/>
Apr 13 15:08:48 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:port uuid="a1f1b21e-12c3-4310-9ef0-791f4d09fc5f">
Apr 13 15:08:48 user nova-compute[71507]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Apr 13 15:08:48 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:port uuid="989ec3b8-1a00-47b5-9a07-71f33cfb6c69">
Apr 13 15:08:48 user nova-compute[71507]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 15:08:48 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:48 user nova-compute[71507]:         <nova:port uuid="c97ac499-c8fa-412e-9452-c6f80e69c879">
Apr 13 15:08:48 user nova-compute[71507]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 15:08:48 user nova-compute[71507]:         </nova:port>
Apr 13 15:08:48 user nova-compute[71507]:       </nova:ports>
Apr 13 15:08:48 user nova-compute[71507]:     </nova:instance>
Apr 13 15:08:48 user nova-compute[71507]:   </metadata>
Apr 13 15:08:48 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:08:48 user nova-compute[71507]:     <system>
Apr 13 15:08:48 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:08:48 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:08:48 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:08:48 user nova-compute[71507]:       <entry name="serial">e84c85a8-b97d-44ac-b0b3-f898860f5944</entry>
Apr 13 15:08:48 user nova-compute[71507]:       <entry name="uuid">e84c85a8-b97d-44ac-b0b3-f898860f5944</entry>
Apr 13 15:08:48 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:08:48 user nova-compute[71507]:     </system>
Apr 13 15:08:48 user nova-compute[71507]:   </sysinfo>
Apr 13 15:08:48 user nova-compute[71507]:   <os>
Apr 13 15:08:48 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:08:48 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:08:48 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:08:48 user nova-compute[71507]:   </os>
Apr 13 15:08:48 user nova-compute[71507]:   <features>
Apr 13 15:08:48 user nova-compute[71507]:     <acpi/>
Apr 13 15:08:48 user nova-compute[71507]:     <apic/>
Apr 13 15:08:48 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:08:48 user nova-compute[71507]:   </features>
Apr 13 15:08:48 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:08:48 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:08:48 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:08:48 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:08:48 user nova-compute[71507]:   </clock>
Apr 13 15:08:48 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:08:48 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:08:48 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:08:48 user nova-compute[71507]:   </cpu>
Apr 13 15:08:48 user nova-compute[71507]:   <devices>
Apr 13 15:08:48 user nova-compute[71507]:     <disk type="file" device="cdrom">
Apr 13 15:08:48 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 15:08:48 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/e84c85a8-b97d-44ac-b0b3-f898860f5944/disk.config"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="hda" bus="ide"/>
Apr 13 15:08:48 user nova-compute[71507]:     </disk>
Apr 13 15:08:48 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:08:48 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:08:48 user nova-compute[71507]:       <source dev="/dev/sdb"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <serial>a098f171-2580-4930-a4a3-79cac86e30d6</serial>
Apr 13 15:08:48 user nova-compute[71507]:     </disk>
Apr 13 15:08:48 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:08:48 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:08:48 user nova-compute[71507]:       <source dev="/dev/sdc"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <serial>3296f7da-aff3-46a3-8567-6d8fd71c9ece</serial>
Apr 13 15:08:48 user nova-compute[71507]:     </disk>
Apr 13 15:08:48 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:08:48 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:08:48 user nova-compute[71507]:       <source dev="/dev/sdd"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="vdc" bus="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <serial>a62eeb8c-6d75-4da8-8262-5afab3861b5a</serial>
Apr 13 15:08:48 user nova-compute[71507]:     </disk>
Apr 13 15:08:48 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:48 user nova-compute[71507]:       <mac address="fa:16:3e:c6:6c:09"/>
Apr 13 15:08:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="tap6e4ead67-98"/>
Apr 13 15:08:48 user nova-compute[71507]:     </interface>
Apr 13 15:08:48 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:48 user nova-compute[71507]:       <mac address="fa:16:3e:6f:39:4f"/>
Apr 13 15:08:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="tapf81f8894-95"/>
Apr 13 15:08:48 user nova-compute[71507]:     </interface>
Apr 13 15:08:48 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:48 user nova-compute[71507]:       <mac address="fa:16:3e:82:84:7e"/>
Apr 13 15:08:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="tapd2e29dc8-81"/>
Apr 13 15:08:48 user nova-compute[71507]:     </interface>
Apr 13 15:08:48 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:48 user nova-compute[71507]:       <mac address="fa:16:3e:20:b6:e3"/>
Apr 13 15:08:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="tap0bbdcb7f-44"/>
Apr 13 15:08:48 user nova-compute[71507]:     </interface>
Apr 13 15:08:48 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:48 user nova-compute[71507]:       <mac address="fa:16:3e:61:5f:b6"/>
Apr 13 15:08:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="tapa1f1b21e-12"/>
Apr 13 15:08:48 user nova-compute[71507]:     </interface>
Apr 13 15:08:48 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:48 user nova-compute[71507]:       <mac address="fa:16:3e:0f:a7:98"/>
Apr 13 15:08:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="tap989ec3b8-1a"/>
Apr 13 15:08:48 user nova-compute[71507]:     </interface>
Apr 13 15:08:48 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:08:48 user nova-compute[71507]:       <mac address="fa:16:3e:e3:15:e7"/>
Apr 13 15:08:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:08:48 user nova-compute[71507]:       <target dev="tapc97ac499-c8"/>
Apr 13 15:08:48 user nova-compute[71507]:     </interface>
Apr 13 15:08:48 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:08:48 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/e84c85a8-b97d-44ac-b0b3-f898860f5944/console.log" append="off"/>
Apr 13 15:08:48 user nova-compute[71507]:     </serial>
Apr 13 15:08:48 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:08:48 user nova-compute[71507]:     <video>
Apr 13 15:08:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:08:48 user nova-compute[71507]:     </video>
Apr 13 15:08:48 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:08:48 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:08:48 user nova-compute[71507]:     </rng>
Apr 13 15:08:48 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:08:48 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:08:48 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:08:48 user nova-compute[71507]:     </memballoon>
Apr 13 15:08:48 user nova-compute[71507]:   </devices>
Apr 13 15:08:48 user nova-compute[71507]: </domain>
Apr 13 15:08:48 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6c:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4ead67-98a8-4a15-b31e-6ed9a0d075c5,network=Network(7a95cb70-f248-48c3-bcaf-29e420112188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4ead67-98') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6c:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4ead67-98a8-4a15-b31e-6ed9a0d075c5,network=Network(7a95cb70-f248-48c3-bcaf-29e420112188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4ead67-98') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e4ead67-98, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e4ead67-98, col_values=(('external_ids', {'iface-id': '6e4ead67-98a8-4a15-b31e-6ed9a0d075c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:6c:09', 'vm-uuid': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: INFO os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6c:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4ead67-98a8-4a15-b31e-6ed9a0d075c5,network=Network(7a95cb70-f248-48c3-bcaf-29e420112188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4ead67-98')
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:39:4f,bridge_name='br-int',has_traffic_filtering=True,id=f81f8894-95c8-443a-92e6-0bbc31c8e87c,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81f8894-95') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:39:4f,bridge_name='br-int',has_traffic_filtering=True,id=f81f8894-95c8-443a-92e6-0bbc31c8e87c,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81f8894-95') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf81f8894-95, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf81f8894-95, col_values=(('external_ids', {'iface-id': 'f81f8894-95c8-443a-92e6-0bbc31c8e87c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:39:4f', 'vm-uuid': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: INFO os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:39:4f,bridge_name='br-int',has_traffic_filtering=True,id=f81f8894-95c8-443a-92e6-0bbc31c8e87c,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81f8894-95')
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2e29dc8-81b4-4712-9be4-e97c7f116aed,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2e29dc8-81') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2e29dc8-81b4-4712-9be4-e97c7f116aed,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2e29dc8-81') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2e29dc8-81, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2e29dc8-81, col_values=(('external_ids', {'iface-id': 'd2e29dc8-81b4-4712-9be4-e97c7f116aed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:84:7e', 'vm-uuid': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: INFO os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2e29dc8-81b4-4712-9be4-e97c7f116aed,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2e29dc8-81')
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=0bbdcb7f-44fc-4144-9dcc-b82be1a036fd,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbdcb7f-44') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=0bbdcb7f-44fc-4144-9dcc-b82be1a036fd,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbdcb7f-44') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bbdcb7f-44, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bbdcb7f-44, col_values=(('external_ids', {'iface-id': '0bbdcb7f-44fc-4144-9dcc-b82be1a036fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:b6:e3', 'vm-uuid': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: INFO os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=0bbdcb7f-44fc-4144-9dcc-b82be1a036fd,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbdcb7f-44')
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5f:b6,bridge_name='br-int',has_traffic_filtering=True,id=a1f1b21e-12c3-4310-9ef0-791f4d09fc5f,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f1b21e-12') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5f:b6,bridge_name='br-int',has_traffic_filtering=True,id=a1f1b21e-12c3-4310-9ef0-791f4d09fc5f,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f1b21e-12') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1f1b21e-12, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1f1b21e-12, col_values=(('external_ids', {'iface-id': 'a1f1b21e-12c3-4310-9ef0-791f4d09fc5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:5f:b6', 'vm-uuid': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: INFO os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5f:b6,bridge_name='br-int',has_traffic_filtering=True,id=a1f1b21e-12c3-4310-9ef0-791f4d09fc5f,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f1b21e-12')
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=989ec3b8-1a00-47b5-9a07-71f33cfb6c69,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989ec3b8-1a') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=989ec3b8-1a00-47b5-9a07-71f33cfb6c69,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989ec3b8-1a') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap989ec3b8-1a, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap989ec3b8-1a, col_values=(('external_ids', {'iface-id': '989ec3b8-1a00-47b5-9a07-71f33cfb6c69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:a7:98', 'vm-uuid': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: INFO os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=989ec3b8-1a00-47b5-9a07-71f33cfb6c69,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989ec3b8-1a')
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:15:e7,bridge_name='br-int',has_traffic_filtering=True,id=c97ac499-c8fa-412e-9452-c6f80e69c879,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc97ac499-c8') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:15:e7,bridge_name='br-int',has_traffic_filtering=True,id=c97ac499-c8fa-412e-9452-c6f80e69c879,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc97ac499-c8') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc97ac499-c8, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc97ac499-c8, col_values=(('external_ids', {'iface-id': 'c97ac499-c8fa-412e-9452-c6f80e69c879', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:15:e7', 'vm-uuid': 'e84c85a8-b97d-44ac-b0b3-f898860f5944'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:48 user nova-compute[71507]: INFO os_vif [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:15:e7,bridge_name='br-int',has_traffic_filtering=True,id=c97ac499-c8fa-412e-9452-c6f80e69c879,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc97ac499-c8')
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] No BDM found with device name hda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] No VIF found with MAC fa:16:3e:c6:6c:09, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] No VIF found with MAC fa:16:3e:61:5f:b6, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:08:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Using config drive
Apr 13 15:08:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Creating config drive at /opt/stack/data/nova/instances/e84c85a8-b97d-44ac-b0b3-f898860f5944/disk.config
Apr 13 15:08:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e84c85a8-b97d-44ac-b0b3-f898860f5944/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzrg9i_hr {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e84c85a8-b97d-44ac-b0b3-f898860f5944/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzrg9i_hr" returned: 0 in 0.060s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:50 user nova-compute[71507]: WARNING nova.compute.manager [req-afbe078b-307a-468e-b1b8-335eceecc7a3 req-21bd1f97-45be-4d5f-920b-500936191d5d service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance with vm_state building and task_state spawning.
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:51 user nova-compute[71507]: WARNING nova.compute.manager [req-adf268a9-9f60-4297-9717-18806a605fb0 req-377e0a96-b406-4559-99d6-e8b1313fece7 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance with vm_state building and task_state spawning.
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:52 user nova-compute[71507]: WARNING nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance with vm_state building and task_state spawning.
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:52 user nova-compute[71507]: WARNING nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c for instance with vm_state building and task_state spawning.
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:52 user nova-compute[71507]: WARNING nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c for instance with vm_state building and task_state spawning.
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:52 user nova-compute[71507]: WARNING nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed for instance with vm_state building and task_state spawning.
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:52 user nova-compute[71507]: WARNING nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed for instance with vm_state building and task_state spawning.
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:52 user nova-compute[71507]: WARNING nova.compute.manager [req-abfad92a-082b-4a58-9141-a6a29af90397 req-152f7775-d5f0-47cc-8c14-e03a0e9abceb service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance with vm_state building and task_state spawning.
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:53 user nova-compute[71507]: WARNING nova.compute.manager [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance with vm_state building and task_state spawning.
Apr 13 15:08:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:53 user nova-compute[71507]: WARNING nova.compute.manager [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance with vm_state building and task_state spawning.
Apr 13 15:08:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:53 user nova-compute[71507]: WARNING nova.compute.manager [req-8fbb9a23-315b-4847-97ab-b9922ae79c81 req-397a8de1-95a5-44b9-afac-503db41ff092 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance with vm_state building and task_state spawning.
Apr 13 15:08:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:08:53 user nova-compute[71507]: INFO nova.compute.claims [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Claim successful on node user
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398534.5508287, e84c85a8-b97d-44ac-b0b3-f898860f5944 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:54 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] VM Resumed (Lifecycle Event)
Apr 13 15:08:54 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:08:54 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance spawned successfully.
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:08:54 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398534.5591514, e84c85a8-b97d-44ac-b0b3-f898860f5944 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:08:54 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] VM Started (Lifecycle Event)
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:08:54 user nova-compute[71507]: INFO nova.virt.block_device [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Booting with volume 0ddca559-4699-4c09-aca9-db61ea2e7961 at /dev/vda
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.policy [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fc0cce3df7540078438186f46ca4621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7227559570b54e92be19d25938523b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:08:54 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:08:54 user nova-compute[71507]: INFO nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Took 10.84 seconds to spawn the instance on the hypervisor.
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG os_brick.utils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a95737-1610-4efd-bb19-2580f89d6a8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:54 user nova-compute[71507]: WARNING nova.compute.manager [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance with vm_state building and task_state spawning.
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:54 user nova-compute[71507]: WARNING nova.compute.manager [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-c97ac499-c8fa-412e-9452-c6f80e69c879 for instance with vm_state building and task_state spawning.
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:08:54 user nova-compute[71507]: WARNING nova.compute.manager [req-e2ad0d62-da32-42ce-8a5e-a538960a0d38 req-d6ee343a-cfc7-478b-94d1-a5f779c71cce service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-c97ac499-c8fa-412e-9452-c6f80e69c879 for instance with vm_state building and task_state spawning.
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0c2f51-978a-480c-a194-e4ee066fde67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:54 user nova-compute[71507]: INFO nova.compute.manager [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Took 29.41 seconds to build instance.
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17e0aa8-2ae8-45ff-af19-95f02e377126]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[878d59ca-ab71-4d27-b961-029c6c15fbc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4e510b0-f08a-4c2f-bd4e-144cc6af68cc tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.556s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:08:54 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:08:54 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[82478887-8d50-4538-83ad-a2112ba949b1]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG os_brick.utils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:08:54 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating existing volume attachment record: db5ad745-8637-4102-a1cc-84b1a5b7d857 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:08:55 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Successfully created port: b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Successfully updated port: b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquired lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing instance network info cache due to event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] Acquiring lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating instance_info_cache with network_info: [{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Releasing lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Instance network_info: |[{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] Acquired lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:08:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:08:57 user nova-compute[71507]: DEBUG nova.network.neutron [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updated VIF entry in instance network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:08:57 user nova-compute[71507]: DEBUG nova.network.neutron [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating instance_info_cache with network_info: [{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:08:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9d1ca3d2-d075-44b1-be06-9cae4c0fc0ea req-29a79691-b031-4d01-882d-5fec62a5d702 service nova] Releasing lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:08:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:08:59 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Creating image(s)
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Ensure instance console log exists: /opt/stack/data/nova/instances/179b6945-589d-402c-a89e-6b8d68725211/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Start _get_guest_xml network_info=[{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFEgzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '179b6945-589d-402c-a89e-6b8d68725211', 'attached_at': '', 'detached_at': '', 'volume_id': '0ddca559-4699-4c09-aca9-db61ea2e7961', 'serial': '0ddca559-4699-4c09-aca9-db61ea2e7961'}, 'attachment_id': 'db5ad745-8637-4102-a1cc-84b1a5b7d857', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:08:59 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:59 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFEgzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:08:59 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:08:59 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:08:59 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa302f87-7f53-4645-b109-074ff84aa59a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:08:59 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a75458-7335-4ab1-824d-5d4326ca478f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961] added
Apr 13 15:08:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a269da9a-9f81-4dc0-963d-2aeb7eaccb70]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a011e6-eb1f-48ca-a6e5-9b0a660c4c90]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrFEgzON {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrFEgzON" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[96459915-c21d-4232-874e-80114f5d26eb]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WrFEgzON'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67365b0-54a2-46ca-9c5c-67eeae8b696d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5546f4ae-7bf0-474b-bd0a-ed9e70f8d755]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:08:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:08:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ab3074-6121-4e21-a2ce-b327c2116472]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260]
Apr 13 15:08:59 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260] successful.
Apr 13 15:08:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[504218e0-519a-4f2b-9cbf-ddc2072360cc]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb9cf6f-6479-4c1a-a72f-4dc815671d8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:08:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:08:59 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:08:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f313f0-29e5-46e6-ae14-1684f460b1bb]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:08:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFEgzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23162376437306534', 'path': '/dev/sde'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162376437306534', 'path': '/dev/sde'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-411290166',display_name='tempest-TestShelveInstance-server-411290166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-411290166',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMiNMWIbugIqPibluDtkgkNEHAz0dy1D5iz8h+LzuOQnT0xmd5kr4yKVwXHq5lSKq5W4WLRwRbSWAGEOzySrgPdrDDGPAIFjjmc2lQ7zaPxRPWJoiG7d4rgdJ1tvZwk/g==',key_name='tempest-TestShelveInstance-771163491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7227559570b54e92be19d25938523b49',ramdisk_id='',reservation_id='r-btkem4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1754998277',owner_user_name='tempest-TestShelveInstance-1754998277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:55Z,user_data=None,user_id='2fc0cce3df7540078438186f46ca4621',uuid=179b6945-589d-402c-a89e-6b8d68725211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converting VIF {"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lazy-loading 'pci_devices' on Instance uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:09:00 user nova-compute[71507]:   <uuid>179b6945-589d-402c-a89e-6b8d68725211</uuid>
Apr 13 15:09:00 user nova-compute[71507]:   <name>instance-0000000c</name>
Apr 13 15:09:00 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:09:00 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:09:00 user nova-compute[71507]:   <metadata>
Apr 13 15:09:00 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:09:00 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:09:00 user nova-compute[71507]:       <nova:name>tempest-TestShelveInstance-server-411290166</nova:name>
Apr 13 15:09:00 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:08:59</nova:creationTime>
Apr 13 15:09:00 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:09:00 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:09:00 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:09:00 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:09:00 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:09:00 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:09:00 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:09:00 user nova-compute[71507]:       <nova:owner>
Apr 13 15:09:00 user nova-compute[71507]:         <nova:user uuid="2fc0cce3df7540078438186f46ca4621">tempest-TestShelveInstance-1754998277-project-member</nova:user>
Apr 13 15:09:00 user nova-compute[71507]:         <nova:project uuid="7227559570b54e92be19d25938523b49">tempest-TestShelveInstance-1754998277</nova:project>
Apr 13 15:09:00 user nova-compute[71507]:       </nova:owner>
Apr 13 15:09:00 user nova-compute[71507]:       <nova:ports>
Apr 13 15:09:00 user nova-compute[71507]:         <nova:port uuid="b6a42460-29f0-496d-a7ba-d7ae2259f317">
Apr 13 15:09:00 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 15:09:00 user nova-compute[71507]:         </nova:port>
Apr 13 15:09:00 user nova-compute[71507]:       </nova:ports>
Apr 13 15:09:00 user nova-compute[71507]:     </nova:instance>
Apr 13 15:09:00 user nova-compute[71507]:   </metadata>
Apr 13 15:09:00 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:09:00 user nova-compute[71507]:     <system>
Apr 13 15:09:00 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:09:00 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:09:00 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:09:00 user nova-compute[71507]:       <entry name="serial">179b6945-589d-402c-a89e-6b8d68725211</entry>
Apr 13 15:09:00 user nova-compute[71507]:       <entry name="uuid">179b6945-589d-402c-a89e-6b8d68725211</entry>
Apr 13 15:09:00 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:09:00 user nova-compute[71507]:     </system>
Apr 13 15:09:00 user nova-compute[71507]:   </sysinfo>
Apr 13 15:09:00 user nova-compute[71507]:   <os>
Apr 13 15:09:00 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:09:00 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:09:00 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:09:00 user nova-compute[71507]:   </os>
Apr 13 15:09:00 user nova-compute[71507]:   <features>
Apr 13 15:09:00 user nova-compute[71507]:     <acpi/>
Apr 13 15:09:00 user nova-compute[71507]:     <apic/>
Apr 13 15:09:00 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:09:00 user nova-compute[71507]:   </features>
Apr 13 15:09:00 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:09:00 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:09:00 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:09:00 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:09:00 user nova-compute[71507]:   </clock>
Apr 13 15:09:00 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:09:00 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:09:00 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:09:00 user nova-compute[71507]:   </cpu>
Apr 13 15:09:00 user nova-compute[71507]:   <devices>
Apr 13 15:09:00 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:09:00 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:09:00 user nova-compute[71507]:       <source dev="/dev/sde"/>
Apr 13 15:09:00 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:09:00 user nova-compute[71507]:       <serial>0ddca559-4699-4c09-aca9-db61ea2e7961</serial>
Apr 13 15:09:00 user nova-compute[71507]:     </disk>
Apr 13 15:09:00 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:09:00 user nova-compute[71507]:       <mac address="fa:16:3e:be:8a:4c"/>
Apr 13 15:09:00 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:09:00 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:09:00 user nova-compute[71507]:       <target dev="tapb6a42460-29"/>
Apr 13 15:09:00 user nova-compute[71507]:     </interface>
Apr 13 15:09:00 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:09:00 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/179b6945-589d-402c-a89e-6b8d68725211/console.log" append="off"/>
Apr 13 15:09:00 user nova-compute[71507]:     </serial>
Apr 13 15:09:00 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:09:00 user nova-compute[71507]:     <video>
Apr 13 15:09:00 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:09:00 user nova-compute[71507]:     </video>
Apr 13 15:09:00 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:09:00 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:09:00 user nova-compute[71507]:     </rng>
Apr 13 15:09:00 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:09:00 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:09:00 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:09:00 user nova-compute[71507]:     </memballoon>
Apr 13 15:09:00 user nova-compute[71507]:   </devices>
Apr 13 15:09:00 user nova-compute[71507]: </domain>
Apr 13 15:09:00 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-411290166',display_name='tempest-TestShelveInstance-server-411290166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-411290166',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMiNMWIbugIqPibluDtkgkNEHAz0dy1D5iz8h+LzuOQnT0xmd5kr4yKVwXHq5lSKq5W4WLRwRbSWAGEOzySrgPdrDDGPAIFjjmc2lQ7zaPxRPWJoiG7d4rgdJ1tvZwk/g==',key_name='tempest-TestShelveInstance-771163491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7227559570b54e92be19d25938523b49',ramdisk_id='',reservation_id='r-btkem4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1754998277',owner_user_name='tempest-TestShelveInstance-1754998277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:08:55Z,user_data=None,user_id='2fc0cce3df7540078438186f46ca4621',uuid=179b6945-589d-402c-a89e-6b8d68725211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converting VIF {"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG os_vif [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6a42460-29, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6a42460-29, col_values=(('external_ids', {'iface-id': 'b6a42460-29f0-496d-a7ba-d7ae2259f317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:8a:4c', 'vm-uuid': '179b6945-589d-402c-a89e-6b8d68725211'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:09:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:00 user nova-compute[71507]: INFO os_vif [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29')
Apr 13 15:09:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] No VIF found with MAC fa:16:3e:be:8a:4c, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] No waiting events found dispatching network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:02 user nova-compute[71507]: WARNING nova.compute.manager [req-a7b023d1-deaf-4b97-84b9-7224f5decd67 req-5334616e-f953-4b34-971d-401c6930224b service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received unexpected event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance with vm_state building and task_state spawning.
Apr 13 15:09:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398544.5443368, 179b6945-589d-402c-a89e-6b8d68725211 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:09:04 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] VM Resumed (Lifecycle Event)
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:09:04 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Instance spawned successfully.
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:09:04 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398544.5455809, 179b6945-589d-402c-a89e-6b8d68725211 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:09:04 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] VM Started (Lifecycle Event)
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:09:04 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:09:04 user nova-compute[71507]: INFO nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Took 5.22 seconds to spawn the instance on the hypervisor.
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] No waiting events found dispatching network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:04 user nova-compute[71507]: WARNING nova.compute.manager [req-9947ac58-b684-4167-926f-1bad4dd432a3 req-c9efbd33-d5a2-44de-9dee-f14b5566d543 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received unexpected event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance with vm_state building and task_state spawning.
Apr 13 15:09:04 user nova-compute[71507]: INFO nova.compute.manager [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Took 10.84 seconds to build instance.
Apr 13 15:09:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a60f4b2c-1f82-4730-82bc-b5df21cc6300 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.937s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:14 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:14 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:09:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:09:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:18 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:09:18 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7132MB free_disk=26.424644470214844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 63f69337-7ae4-4125-a560-f6cbcb2298d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 179b6945-589d-402c-a89e-6b8d68725211 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 654608ee-5897-429a-b19c-6845d4e84818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:09:18 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "58a0788e-df82-4c1e-97dd-1d246048afc5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lazy-loading 'flavor' on Instance uuid 58a0788e-df82-4c1e-97dd-1d246048afc5 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "58a0788e-df82-4c1e-97dd-1d246048afc5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:19 user nova-compute[71507]: INFO nova.compute.manager [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Attaching volume c02fb78a-5179-4ed7-b0a3-4798f27a7563 to /dev/vdb
Apr 13 15:09:19 user nova-compute[71507]: DEBUG os_brick.utils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ff836-4c57-4564-9405-2e54ffed029c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a594b26c-4147-4823-8007-f1152c246456]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a71afe6-0c03-447e-8781-27d2967e233f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3398c251-1395-4b69-8c26-2912895dfc80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:09:19 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8af88e1-6018-4651-a9a2-7c821de6339e]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG os_brick.utils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Updating existing volume attachment record: 56d87019-5bd0-41bb-ba37-25c14ef6356d {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:09:19 user nova-compute[71507]: INFO nova.compute.manager [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Rescuing
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquired lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:09:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updating instance_info_cache with network_info: [{"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Releasing lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updating instance_info_cache with network_info: [{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-unplugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] No waiting events found dispatching network-vif-unplugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:21 user nova-compute[71507]: WARNING nova.compute.manager [req-fa1dad82-a811-425f-bd3c-e6fc63a5617e req-8dfa23e2-73f1-4bf8-8156-dd1a12bac40b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received unexpected event network-vif-unplugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance with vm_state active and task_state rescuing.
Apr 13 15:09:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Instance destroyed successfully.
Apr 13 15:09:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Attempting rescue
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Instance directory exists: not creating {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 15:09:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Creating image(s)
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue" returned: 0 in 0.106s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'migration_context' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Start _get_guest_xml network_info=[{"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "vif_mac": "fa:16:3e:c7:dd:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'resources' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'numa_topology' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:21 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:09:21 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-842194501',display_name='tempest-ServerRescueNegativeTestJSON-server-842194501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-842194501',id=3,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-lsu3syxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:47Z,user_data=None,user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=25f57234-8818-44d3-b476-d6cfba7b2810,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "vif_mac": "fa:16:3e:c7:dd:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "vif_mac": "fa:16:3e:c7:dd:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=e4b886a7-88e3-42e3-98b8-b0fa9d67391a,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b886a7-88') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'pci_devices' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:09:21 user nova-compute[71507]:   <uuid>25f57234-8818-44d3-b476-d6cfba7b2810</uuid>
Apr 13 15:09:21 user nova-compute[71507]:   <name>instance-00000003</name>
Apr 13 15:09:21 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:09:21 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:09:21 user nova-compute[71507]:   <metadata>
Apr 13 15:09:21 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:09:21 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:09:21 user nova-compute[71507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-842194501</nova:name>
Apr 13 15:09:21 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:09:21</nova:creationTime>
Apr 13 15:09:21 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:09:21 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:09:21 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:09:21 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:09:21 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:09:21 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:09:21 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:09:21 user nova-compute[71507]:       <nova:owner>
Apr 13 15:09:21 user nova-compute[71507]:         <nova:user uuid="c83940ddaaf64d94b40df9d00349aa91">tempest-ServerRescueNegativeTestJSON-66620130-project-member</nova:user>
Apr 13 15:09:21 user nova-compute[71507]:         <nova:project uuid="9bad96fcfa0d4691af2a7990ba9dbd09">tempest-ServerRescueNegativeTestJSON-66620130</nova:project>
Apr 13 15:09:21 user nova-compute[71507]:       </nova:owner>
Apr 13 15:09:21 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:09:21 user nova-compute[71507]:       <nova:ports>
Apr 13 15:09:21 user nova-compute[71507]:         <nova:port uuid="e4b886a7-88e3-42e3-98b8-b0fa9d67391a">
Apr 13 15:09:21 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 15:09:21 user nova-compute[71507]:         </nova:port>
Apr 13 15:09:21 user nova-compute[71507]:       </nova:ports>
Apr 13 15:09:21 user nova-compute[71507]:     </nova:instance>
Apr 13 15:09:21 user nova-compute[71507]:   </metadata>
Apr 13 15:09:21 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:09:21 user nova-compute[71507]:     <system>
Apr 13 15:09:21 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:09:21 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:09:21 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:09:21 user nova-compute[71507]:       <entry name="serial">25f57234-8818-44d3-b476-d6cfba7b2810</entry>
Apr 13 15:09:21 user nova-compute[71507]:       <entry name="uuid">25f57234-8818-44d3-b476-d6cfba7b2810</entry>
Apr 13 15:09:21 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:09:21 user nova-compute[71507]:     </system>
Apr 13 15:09:21 user nova-compute[71507]:   </sysinfo>
Apr 13 15:09:21 user nova-compute[71507]:   <os>
Apr 13 15:09:21 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:09:21 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:09:21 user nova-compute[71507]:   </os>
Apr 13 15:09:21 user nova-compute[71507]:   <features>
Apr 13 15:09:21 user nova-compute[71507]:     <acpi/>
Apr 13 15:09:21 user nova-compute[71507]:     <apic/>
Apr 13 15:09:21 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:09:21 user nova-compute[71507]:   </features>
Apr 13 15:09:21 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:09:21 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:09:21 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:09:21 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:09:21 user nova-compute[71507]:   </clock>
Apr 13 15:09:21 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:09:21 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:09:21 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:09:21 user nova-compute[71507]:   </cpu>
Apr 13 15:09:21 user nova-compute[71507]:   <devices>
Apr 13 15:09:21 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:09:21 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:09:21 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue"/>
Apr 13 15:09:21 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:09:21 user nova-compute[71507]:     </disk>
Apr 13 15:09:21 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:09:21 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:09:21 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk"/>
Apr 13 15:09:21 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:09:21 user nova-compute[71507]:     </disk>
Apr 13 15:09:21 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:09:21 user nova-compute[71507]:       <mac address="fa:16:3e:c7:dd:13"/>
Apr 13 15:09:21 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:09:21 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:09:21 user nova-compute[71507]:       <target dev="tape4b886a7-88"/>
Apr 13 15:09:21 user nova-compute[71507]:     </interface>
Apr 13 15:09:21 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:09:21 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/console.log" append="off"/>
Apr 13 15:09:21 user nova-compute[71507]:     </serial>
Apr 13 15:09:21 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:09:21 user nova-compute[71507]:     <video>
Apr 13 15:09:21 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:09:21 user nova-compute[71507]:     </video>
Apr 13 15:09:21 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:09:21 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:09:21 user nova-compute[71507]:     </rng>
Apr 13 15:09:21 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:09:21 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:09:21 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:09:21 user nova-compute[71507]:     </memballoon>
Apr 13 15:09:21 user nova-compute[71507]:   </devices>
Apr 13 15:09:21 user nova-compute[71507]: </domain>
Apr 13 15:09:21 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:09:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Instance destroyed successfully.
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No VIF found with MAC fa:16:3e:c7:dd:13, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:09:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] No waiting events found dispatching network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:23 user nova-compute[71507]: WARNING nova.compute.manager [req-0ba0a86b-6287-41d4-84eb-012acecfaf45 req-446cfb3f-227a-4e12-9f69-828e1c06cf5b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received unexpected event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance with vm_state active and task_state rescuing.
Apr 13 15:09:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmFnhaQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:09:23 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:09:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:09:23 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:09:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:09:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:09:23 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:09:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5999bd-4ece-40e6-b653-92d7c7b80062]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:09:24 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b891303a-3e57-4687-821b-bc2d03af410d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563] added
Apr 13 15:09:24 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e82b603-5442-42ec-9582-95b5942e2f17]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cad6fa7-df6d-4bc1-9264-e821b574eb27]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmFnhaQG {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmFnhaQG" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c0c086-1f66-4b66-a110-7d889ad96715]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LmFnhaQG'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a645472-ff15-4488-b983-aed27da3d22e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f79975-eba8-4c9a-b973-d1c0c426652c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b5782b-ab2d-4d5a-a37a-9664dc967a6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563, portal: 172.16.0.220,3260]
Apr 13 15:09:24 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563, portal: 172.16.0.220,3260] successful.
Apr 13 15:09:24 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1b56f5-1163-43d0-8f3d-3e733e5614b3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fcf2a9-17c5-4f45-bb33-5305508d4aab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 (non-flash)
Apr 13 15:09:24 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa6cddc-efed-4e6c-913e-584c25848eca]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:09:24 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmFnhaQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] No waiting events found dispatching network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:25 user nova-compute[71507]: WARNING nova.compute.manager [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received unexpected event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance with vm_state active and task_state rescuing.
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] No waiting events found dispatching network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:25 user nova-compute[71507]: WARNING nova.compute.manager [req-25b44ee9-7d93-4505-870f-b79b7879dd40 req-bbc0b30f-910f-470c-b6f2-9f62be59cc2c service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received unexpected event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance with vm_state active and task_state rescuing.
Apr 13 15:09:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23838363061323161', 'path': '/dev/sdf'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838363061323161', 'path': '/dev/sdf'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lazy-loading 'flavor' on Instance uuid 58a0788e-df82-4c1e-97dd-1d246048afc5 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:09:25 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:09:25 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:09:25 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:09:25 user nova-compute[71507]:   <serial>c02fb78a-5179-4ed7-b0a3-4798f27a7563</serial>
Apr 13 15:09:25 user nova-compute[71507]: </disk>
Apr 13 15:09:25 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for 25f57234-8818-44d3-b476-d6cfba7b2810 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398565.5197332, 25f57234-8818-44d3-b476-d6cfba7b2810 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:09:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] VM Resumed (Lifecycle Event)
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5c695e74-4245-4051-970f-590d92ed8330 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:09:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398565.5212688, 25f57234-8818-44d3-b476-d6cfba7b2810 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:09:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] VM Started (Lifecycle Event)
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:09:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] No VIF found with MAC fa:16:3e:d8:d1:0b, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f7502d25-90c3-492d-a172-355b9e5d9cef tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.617s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:09:26 user nova-compute[71507]: INFO nova.compute.manager [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] instance snapshotting
Apr 13 15:09:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Beginning live snapshot process
Apr 13 15:09:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json -f qcow2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json -f qcow2" returned: 0 in 0.158s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json -f qcow2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfg4fhjin/a4154fafdd1d4f008549c3fd588252e2.delta 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfg4fhjin/a4154fafdd1d4f008549c3fd588252e2.delta 1073741824" returned: 0 in 0.057s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:27 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 15:09:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71507) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 13 15:09:27 user nova-compute[71507]: INFO nova.virt.libvirt.host [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] UEFI support detected
Apr 13 15:09:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "58a0788e-df82-4c1e-97dd-1d246048afc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:27 user nova-compute[71507]: INFO nova.compute.manager [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Terminating instance
Apr 13 15:09:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG nova.compute.manager [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received event network-vif-unplugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] Acquiring lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG nova.compute.manager [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] No waiting events found dispatching network-vif-unplugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG nova.compute.manager [req-73ee5bdd-c33d-45c6-b040-03c7f796ce0e req-3fdc5ffe-e7da-4921-b070-af77813ee34d service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received event network-vif-unplugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:09:28 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Instance destroyed successfully.
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lazy-loading 'resources' on Instance uuid 58a0788e-df82-4c1e-97dd-1d246048afc5 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-282341879',display_name='tempest-DeleteServersTestJSON-server-282341879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-282341879',id=1,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:07:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62589c1782f2473ead9b4270af3982f6',ramdisk_id='',reservation_id='r-h5g2t326',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-425509443',owner_user_name='tempest-DeleteServersTestJSON-425509443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:07:45Z,user_data=None,user_id='2844897ef27d4395af0a8f069699ce4d',uuid=58a0788e-df82-4c1e-97dd-1d246048afc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Converting VIF {"id": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "address": "fa:16:3e:d8:d1:0b", "network": {"id": "1f3dba00-8e14-4683-8d13-ebc5e4395913", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-54664870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62589c1782f2473ead9b4270af3982f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap393596c3-b6", "ovs_interfaceid": "393596c3-b6ee-4d5e-bec9-d9e96b9bf93f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d1:0b,bridge_name='br-int',has_traffic_filtering=True,id=393596c3-b6ee-4d5e-bec9-d9e96b9bf93f,network=Network(1f3dba00-8e14-4683-8d13-ebc5e4395913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap393596c3-b6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_vif [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d1:0b,bridge_name='br-int',has_traffic_filtering=True,id=393596c3-b6ee-4d5e-bec9-d9e96b9bf93f,network=Network(1f3dba00-8e14-4683-8d13-ebc5e4395913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap393596c3-b6') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap393596c3-b6, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:09:28 user nova-compute[71507]: INFO os_vif [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d1:0b,bridge_name='br-int',has_traffic_filtering=True,id=393596c3-b6ee-4d5e-bec9-d9e96b9bf93f,network=Network(1f3dba00-8e14-4683-8d13-ebc5e4395913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap393596c3-b6')
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmFnhaQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:09:28 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f28b5f-2ee7-4702-be9f-2ae0c6345323]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:09:28 user nova-compute[71507]: No targets found.
Apr 13 15:09:28 user nova-compute[71507]: iSNS:
Apr 13 15:09:28 user nova-compute[71507]: No targets found.
Apr 13 15:09:28 user nova-compute[71507]: STATIC:
Apr 13 15:09:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece
Apr 13 15:09:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563
Apr 13 15:09:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a
Apr 13 15:09:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6
Apr 13 15:09:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:09:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:28 user nova-compute[71507]: FIRMWARE:
Apr 13 15:09:28 user nova-compute[71507]: No targets found.
Apr 13 15:09:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:09:28 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:09:28 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9558553c-91d9-417b-9fe9-ebb50c6b7efa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad78a63-0773-492e-b975-c5451d69d5dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:28 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:28 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:28 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:28 user nova-compute[71507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 (non-flash)
Apr 13 15:09:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:28 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:28 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:28 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:28 user nova-compute[71507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 (non-flash)
Apr 13 15:09:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab28957be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563'): ({'sdf'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Removing single pathed devices sdf {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e36020-c1ae-4922-9770-065ecce2c126]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aca7ee-3161-4997-ac0a-a217a54a69a3]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Flushing IO for device /dev/sdf {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68694ac-9e7a-4469-bee2-b20f8b74bce4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:09:28 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55eb8cc-e8a0-4691-8195-fc043aa0dd28]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7403f400-d5b9-4af2-9f6e-391964eaeb12]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfg4fhjin/a4154fafdd1d4f008549c3fd588252e2.delta /opt/stack/data/nova/instances/snapshots/tmpfg4fhjin/a4154fafdd1d4f008549c3fd588252e2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[350f7595-aa2d-49d3-a31b-6b059fed0a0d]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563, portal: 172.16.0.220,3260]
Apr 13 15:09:28 user nova-compute[71507]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563, portal: 172.16.0.220,3260] successful.
Apr 13 15:09:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c02fb78a-5179-4ed7-b0a3-4798f27a7563 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b183f490-0d37-4725-9268-4c82f1e7fd13]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] <== disconnect_volume: return (355ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:09:28 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Deleting instance files /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5_del
Apr 13 15:09:28 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Deletion of /opt/stack/data/nova/instances/58a0788e-df82-4c1e-97dd-1d246048afc5_del complete
Apr 13 15:09:28 user nova-compute[71507]: INFO nova.compute.manager [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Took 1.56 seconds to destroy the instance on the hypervisor.
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:09:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfg4fhjin/a4154fafdd1d4f008549c3fd588252e2.delta /opt/stack/data/nova/instances/snapshots/tmpfg4fhjin/a4154fafdd1d4f008549c3fd588252e2" returned: 0 in 0.321s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:28 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Snapshot extracted, beginning image upload
Apr 13 15:09:29 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:29 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Took 0.64 seconds to deallocate network for instance.
Apr 13 15:09:29 user nova-compute[71507]: DEBUG nova.compute.manager [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received event network-vif-deleted-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:29 user nova-compute[71507]: INFO nova.compute.manager [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Neutron deleted interface 393596c3-b6ee-4d5e-bec9-d9e96b9bf93f; detaching it from the instance and deleting it from the info cache
Apr 13 15:09:29 user nova-compute[71507]: DEBUG nova.network.neutron [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:29 user nova-compute[71507]: DEBUG nova.compute.manager [req-2394249f-55cd-49d6-baa1-b6c1188e0035 req-86e308ca-56ae-45a4-ad39-05410616082c service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Detach interface failed, port_id=393596c3-b6ee-4d5e-bec9-d9e96b9bf93f, reason: Instance 58a0788e-df82-4c1e-97dd-1d246048afc5 could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:09:29 user nova-compute[71507]: DEBUG nova.compute.manager [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received event network-vif-plugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] Acquiring lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:29 user nova-compute[71507]: DEBUG nova.compute.manager [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] No waiting events found dispatching network-vif-plugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:29 user nova-compute[71507]: WARNING nova.compute.manager [req-3f1626fa-53c0-499f-a3bb-c7baf248b596 req-5abe2b59-0ff5-447a-80d5-91bd4e9cdcd9 service nova] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Received unexpected event network-vif-plugged-393596c3-b6ee-4d5e-bec9-d9e96b9bf93f for instance with vm_state active and task_state deleting.
Apr 13 15:09:30 user nova-compute[71507]: INFO nova.compute.manager [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Took 0.87 seconds to detach 1 volumes for instance.
Apr 13 15:09:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:30 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:09:30 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:09:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:30 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Deleted allocations for instance 58a0788e-df82-4c1e-97dd-1d246048afc5
Apr 13 15:09:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a19c1559-96c7-4f26-8cab-917864944642 tempest-DeleteServersTestJSON-425509443 tempest-DeleteServersTestJSON-425509443-project-member] Lock "58a0788e-df82-4c1e-97dd-1d246048afc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.998s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:31 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Snapshot image upload complete
Apr 13 15:09:31 user nova-compute[71507]: INFO nova.compute.manager [None req-fbc518cf-22ff-4f97-90c4-dd9dcd1ed3e1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Took 5.17 seconds to snapshot the instance on the hypervisor.
Apr 13 15:09:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-changed-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Refreshing instance network info cache due to event network-changed-a534f901-d679-4443-bf28-aaba09bf631f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:09:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] Acquiring lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:09:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] Acquired lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:09:31 user nova-compute[71507]: DEBUG nova.network.neutron [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Refreshing network info cache for port a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:09:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:09:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:32 user nova-compute[71507]: DEBUG nova.network.neutron [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updated VIF entry in instance network info cache for port a534f901-d679-4443-bf28-aaba09bf631f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:09:32 user nova-compute[71507]: DEBUG nova.network.neutron [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating instance_info_cache with network_info: [{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a9a80a3d-6361-4b11-ad4a-eca1707fd252 req-593e2a71-196a-4650-bf27-3f8eb2b2e9fd service nova] Releasing lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:09:32 user nova-compute[71507]: INFO nova.compute.manager [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] instance snapshotting
Apr 13 15:09:32 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Beginning live snapshot process
Apr 13 15:09:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json -f qcow2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json -f qcow2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.128s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw7qp1ij2/200937936be94193ab595d2cfd50aa9d.delta 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw7qp1ij2/200937936be94193ab595d2cfd50aa9d.delta 1073741824" returned: 0 in 0.050s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 15:09:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:09:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:09:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 15:09:34 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:09:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw7qp1ij2/200937936be94193ab595d2cfd50aa9d.delta /opt/stack/data/nova/instances/snapshots/tmpw7qp1ij2/200937936be94193ab595d2cfd50aa9d {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw7qp1ij2/200937936be94193ab595d2cfd50aa9d.delta /opt/stack/data/nova/instances/snapshots/tmpw7qp1ij2/200937936be94193ab595d2cfd50aa9d" returned: 0 in 0.340s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Snapshot extracted, beginning image upload
Apr 13 15:09:37 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Snapshot image upload complete
Apr 13 15:09:37 user nova-compute[71507]: INFO nova.compute.manager [None req-318eefa0-65c0-45d8-baf0-f95d2a233af6 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Took 4.77 seconds to snapshot the instance on the hypervisor.
Apr 13 15:09:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:43 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398568.1166024, 58a0788e-df82-4c1e-97dd-1d246048afc5 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:09:43 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] VM Stopped (Lifecycle Event)
Apr 13 15:09:43 user nova-compute[71507]: DEBUG nova.compute.manager [None req-3297506c-4189-4f17-a221-e9ba35c4aa66 None None] [instance: 58a0788e-df82-4c1e-97dd-1d246048afc5] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:09:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "63f69337-7ae4-4125-a560-f6cbcb2298d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:44 user nova-compute[71507]: INFO nova.compute.manager [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Terminating instance
Apr 13 15:09:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received event network-vif-unplugged-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] Acquiring lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] No waiting events found dispatching network-vif-unplugged-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-862e9a73-55bd-49e8-b0d9-193d9f2e81c7 req-83347ebf-9403-4288-84ea-5c7aed69d9a5 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received event network-vif-unplugged-f1e3287f-407f-49f2-8d91-881e31471ee9 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Instance destroyed successfully.
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.objects.instance [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lazy-loading 'resources' on Instance uuid 63f69337-7ae4-4125-a560-f6cbcb2298d4 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1168002149',display_name='tempest-VolumesNegativeTest-instance-1168002149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1168002149',id=7,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51c1b992977a479883e445330b3d0d97',ramdisk_id='',reservation_id='r-r8pnav0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2050412996',owner_user_name='tempest-VolumesNegativeTest-2050412996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:08Z,user_data=None,user_id='e8adc8b289e548a5ac16b6356753d6dc',uuid=63f69337-7ae4-4125-a560-f6cbcb2298d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Converting VIF {"id": "f1e3287f-407f-49f2-8d91-881e31471ee9", "address": "fa:16:3e:10:03:4f", "network": {"id": "b668ec64-0cea-4c5b-b1c5-438d02e373be", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1bb5aff7c24a6e9eb594ef3258d98d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e3287f-40", "ovs_interfaceid": "f1e3287f-407f-49f2-8d91-881e31471ee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1e3287f-407f-49f2-8d91-881e31471ee9,network=Network(b668ec64-0cea-4c5b-b1c5-438d02e373be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e3287f-40') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG os_vif [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1e3287f-407f-49f2-8d91-881e31471ee9,network=Network(b668ec64-0cea-4c5b-b1c5-438d02e373be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e3287f-40') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1e3287f-40, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:45 user nova-compute[71507]: INFO os_vif [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:03:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1e3287f-407f-49f2-8d91-881e31471ee9,network=Network(b668ec64-0cea-4c5b-b1c5-438d02e373be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e3287f-40')
Apr 13 15:09:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Deleting instance files /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4_del
Apr 13 15:09:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Deletion of /opt/stack/data/nova/instances/63f69337-7ae4-4125-a560-f6cbcb2298d4_del complete
Apr 13 15:09:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 15:09:45 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received event network-changed-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Refreshing instance network info cache due to event network-changed-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] Acquiring lock "refresh_cache-051e6c4e-3d10-4b43-9099-7abffd84d0d9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] Acquired lock "refresh_cache-051e6c4e-3d10-4b43-9099-7abffd84d0d9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.network.neutron [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Refreshing network info cache for port a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:45 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Took 0.57 seconds to deallocate network for instance.
Apr 13 15:09:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-ab800df8-4cc4-4ee0-84ac-2444730830e3 req-5a4a6e15-2aff-4d18-836a-113d97b86d88 service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received event network-vif-deleted-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:46 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Deleted allocations for instance 63f69337-7ae4-4125-a560-f6cbcb2298d4
Apr 13 15:09:46 user nova-compute[71507]: DEBUG nova.network.neutron [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Updated VIF entry in instance network info cache for port a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG nova.network.neutron [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Updating instance_info_cache with network_info: [{"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-49a364c6-de1d-4cbc-aae5-766b36b1fa00 tempest-VolumesNegativeTest-2050412996 tempest-VolumesNegativeTest-2050412996-project-member] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-74b19886-1e47-4554-bd2f-603ddee5ae94 req-4fa993c1-3f09-4594-ae59-eec3be7e45d1 service nova] Releasing lock "refresh_cache-051e6c4e-3d10-4b43-9099-7abffd84d0d9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received event network-vif-plugged-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] Acquiring lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] Lock "63f69337-7ae4-4125-a560-f6cbcb2298d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] No waiting events found dispatching network-vif-plugged-f1e3287f-407f-49f2-8d91-881e31471ee9 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:09:46 user nova-compute[71507]: WARNING nova.compute.manager [req-e5df35ea-9e55-4cd4-9afc-f080728207f2 req-505b0af8-50f3-4712-a542-3fba9012b48f service nova] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Received unexpected event network-vif-plugged-f1e3287f-407f-49f2-8d91-881e31471ee9 for instance with vm_state deleted and task_state None.
Apr 13 15:09:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG nova.objects.instance [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lazy-loading 'flavor' on Instance uuid 051e6c4e-3d10-4b43-9099-7abffd84d0d9 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:47 user nova-compute[71507]: INFO nova.compute.manager [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Attaching volume c1149929-63dc-4bc4-addf-053acb5ebe92 to /dev/sdc
Apr 13 15:09:47 user nova-compute[71507]: DEBUG os_brick.utils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[56469650-f081-4e96-8238-2be5ebbcbf83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[888e5e01-e3b2-4868-ab99-9657fa8293c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73bd97-708d-419a-b33e-a15777dc33d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5df5ffd-af4c-477a-a7e9-343219c0e45a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:09:47 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:09:47 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[433486b1-104c-4fcb-8be7-a17f0e5a51b5]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG os_brick.utils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Updating existing volume attachment record: da2d7179-7cd1-4aca-8fb6-5288272fa3ce {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:09:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received event network-changed-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Refreshing instance network info cache due to event network-changed-daee05dc-ae07-4d68-94f3-7c2ee8039327. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] Acquiring lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] Acquired lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG nova.network.neutron [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Refreshing network info cache for port daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joednViy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:09:51 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:09:51 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:09:51 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e449ad60-e3a4-4a54-8b2c-b72e0859e0f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:09:51 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c308cd6a-dae3-47af-9da1-fbff18610b22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92] added
Apr 13 15:09:51 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[45057917-f0b7-4d23-8e21-a4a0ffef9744]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9e3f49-abd8-47db-b0db-70d246184d94]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joednViy {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joednViy" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42f5d30-3c7c-440d-be04-f80579f3be5e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'joednViy'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86b83d9-f206-4623-abed-ed058b8d4de4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8b7905-3e7e-4264-a71f-90329c09c455]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:51 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:51 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:51 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:51 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:51 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:51 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:51 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:51 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed95445-acff-4e0c-9374-7c2d51096c96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92, portal: 172.16.0.220,3260]
Apr 13 15:09:51 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92, portal: 172.16.0.220,3260] successful.
Apr 13 15:09:51 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb0ad97-866b-4cbd-8293-db64c6a39b06]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2d0d80-1d8c-4beb-8615-9c94fc8ae19e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:52 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:52 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:52 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:52 user nova-compute[71507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 (non-flash)
Apr 13 15:09:52 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:52 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:52 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:52 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:52 user nova-compute[71507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 (non-flash)
Apr 13 15:09:52 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[62749f22-be84-4872-9e88-31d44cc11dc9]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG nova.network.neutron [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Updated VIF entry in instance network info cache for port daee05dc-ae07-4d68-94f3-7c2ee8039327. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG nova.network.neutron [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Updating instance_info_cache with network_info: [{"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3a90f499-ac15-4527-b293-10360495b979 req-a61bd26a-e7b3-4c04-b336-e260bcc0f3cf service nova] Releasing lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:09:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joednViy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26363356365323337', 'path': '/dev/sdf'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363356365323337', 'path': '/dev/sdf'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG nova.objects.instance [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lazy-loading 'flavor' on Instance uuid 051e6c4e-3d10-4b43-9099-7abffd84d0d9 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:09:53 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:09:53 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:09:53 user nova-compute[71507]:   <target dev="sdc" bus="scsi"/>
Apr 13 15:09:53 user nova-compute[71507]:   <serial>c1149929-63dc-4bc4-addf-053acb5ebe92</serial>
Apr 13 15:09:53 user nova-compute[71507]:   <address type="drive" controller="0" unit="2"/>
Apr 13 15:09:53 user nova-compute[71507]: </disk>
Apr 13 15:09:53 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'flavor' on Instance uuid 1be0a3f9-0dae-4739-9f1e-0bb416a97719 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:53 user nova-compute[71507]: INFO nova.compute.manager [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Attaching volume d6ada0a7-ffdb-481e-a557-ba3dec80ef65 to /dev/vdb
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.utils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a833f7b-75f3-4271-8fd6-efb7678ddcd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6886faa5-9e33-42e3-8e8b-ec9008fde3d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbe7f8f-2cae-4f86-9937-21322c229354]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[383b20e3-62e6-45e6-8982-1c8f32ab25b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] No BDM found with device name sda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] No VIF found with MAC fa:16:3e:93:68:92, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:09:53 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2442dc79-a7ee-4f57-ba38-1f6345e13dfe]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG os_brick.utils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Updating existing volume attachment record: 97a7df2b-91ef-4e52-8685-4a4d962175a0 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:09:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e360ddc-b6a1-4a55-af6e-aabe786dbf75 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.626s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received event network-changed-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Refreshing instance network info cache due to event network-changed-49eab8a0-3140-4872-b606-e03f2a243e2f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] Acquiring lock "refresh_cache-193136fc-e6c3-4e70-b7ab-01ced440c6bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] Acquired lock "refresh_cache-193136fc-e6c3-4e70-b7ab-01ced440c6bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.network.neutron [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Refreshing network info cache for port 49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:55 user nova-compute[71507]: INFO nova.compute.manager [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Detaching volume c1149929-63dc-4bc4-addf-053acb5ebe92
Apr 13 15:09:55 user nova-compute[71507]: INFO nova.virt.block_device [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Attempting to driver detach volume c1149929-63dc-4bc4-addf-053acb5ebe92 from mountpoint /dev/sdc
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Attempting to detach device sdc from instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:09:55 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:09:55 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:09:55 user nova-compute[71507]:   <target dev="sdc" bus="scsi"/>
Apr 13 15:09:55 user nova-compute[71507]:   <serial>c1149929-63dc-4bc4-addf-053acb5ebe92</serial>
Apr 13 15:09:55 user nova-compute[71507]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 15:09:55 user nova-compute[71507]: </disk>
Apr 13 15:09:55 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:09:55 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Successfully detached device sdc from instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 from the persistent domain config.
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:09:55 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:09:55 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:09:55 user nova-compute[71507]:   <target dev="sdc" bus="scsi"/>
Apr 13 15:09:55 user nova-compute[71507]:   <serial>c1149929-63dc-4bc4-addf-053acb5ebe92</serial>
Apr 13 15:09:55 user nova-compute[71507]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 15:09:55 user nova-compute[71507]: </disk>
Apr 13 15:09:55 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lazy-loading 'flavor' on Instance uuid 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:55 user nova-compute[71507]: INFO nova.compute.manager [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Attaching volume 3c648678-ad4b-4ce5-b267-ebf3abef2c5d to /dev/vdb
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.utils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e6b361-59d4-4fb4-8fef-bc6a1f57ed2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd53ece8-2682-40ee-968f-8d4ca2419689]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8126db40-46ab-47cc-b4a0-2137dcb63901]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1ed659-7906-4f27-bca8-1904708ccd08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.network.neutron [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Updated VIF entry in instance network info cache for port 49eab8a0-3140-4872-b606-e03f2a243e2f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.network.neutron [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Updating instance_info_cache with network_info: [{"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681398595.630851, 051e6c4e-3d10-4b43-9099-7abffd84d0d9 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:09:55 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Successfully detached device sdc from instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 from the live domain config.
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:09:55 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb599c0-5b73-478f-a6cb-fb2c1afe41ae]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.utils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Updating existing volume attachment record: 875c18cb-0bda-40f0-9fe8-e964e5bf3439 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c9d44aa8-e73c-4f61-9e82-2bd897927642 req-b5f47b73-0f01-41fa-9e41-bd80117b320a service nova] Releasing lock "refresh_cache-193136fc-e6c3-4e70-b7ab-01ced440c6bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joednViy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:09:55 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70abf4a-6647-411f-bb10-0b71f4312ee3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:09:55 user nova-compute[71507]: No targets found.
Apr 13 15:09:55 user nova-compute[71507]: iSNS:
Apr 13 15:09:55 user nova-compute[71507]: No targets found.
Apr 13 15:09:55 user nova-compute[71507]: STATIC:
Apr 13 15:09:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece
Apr 13 15:09:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a
Apr 13 15:09:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92
Apr 13 15:09:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6
Apr 13 15:09:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:09:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:09:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:09:55 user nova-compute[71507]: FIRMWARE:
Apr 13 15:09:55 user nova-compute[71507]: No targets found.
Apr 13 15:09:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:09:55 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:09:55 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeaa511-ad52-466f-982a-585be0fda478]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aee36e-0af5-4c6c-839f-3c9eb51df8c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:55 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:55 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:55 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:55 user nova-compute[71507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 (non-flash)
Apr 13 15:09:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:55 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:55 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:55 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:55 user nova-compute[71507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 (non-flash)
Apr 13 15:09:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab28954940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92'): ({'sdf'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Removing single pathed devices sdf {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c7c170-2296-4832-a6ee-de3cafa61a00]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d128559-9ed7-4930-9dd8-c9a11e4d908b]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Flushing IO for device /dev/sdf {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0995cf3a-fd36-46e7-9d74-8ad1c5f5896d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd5f35f-f4e4-42a7-ac14-b42300335227]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc39faad-dcf1-4182-9870-d71a5eb98a28]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f496bbc6-4d87-40d0-b038-82a36f02c958]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92, portal: 172.16.0.220,3260]
Apr 13 15:09:55 user nova-compute[71507]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92, portal: 172.16.0.220,3260] successful.
Apr 13 15:09:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149929-63dc-4bc4-addf-053acb5ebe92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7baa344-8d73-433c-bf17-24f93805e1b9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] <== disconnect_volume: return (318ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:09:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCkGRVxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:09:58 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:09:58 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:09:58 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30866e4-0803-4849-abe9-1e3dea8d46e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:09:58 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[349505e0-987a-45c9-84ba-9cb04fa9ef61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65] added
Apr 13 15:09:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[16128269-f8f5-4b01-a973-6baace355684]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c22d74-b444-4fd1-9588-51ac6e85846b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCkGRVxD {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCkGRVxD" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa377a8-6764-463d-8ed8-3b9d64298c91]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NCkGRVxD'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6779f6d5-5720-4d71-81ab-c5a50f4684f9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[438152b0-3e25-4b3f-9f88-b4c6d0f2f53c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-changed-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Refreshing instance network info cache due to event network-changed-ce8e302f-1f0b-46e0-82ef-9809a6ad81db. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] Acquiring lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] Acquired lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG nova.network.neutron [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Refreshing network info cache for port ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8cce7b-31f3-43fc-aeb6-b742107d0be7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65, portal: 172.16.0.220,3260]
Apr 13 15:09:58 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65, portal: 172.16.0.220,3260] successful.
Apr 13 15:09:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b124a9f-7f7c-4111-ada6-3c687ce06eda]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d7d4b0-428a-41ec-bb4c-2541aa9092de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)
Apr 13 15:09:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de50183-d348-4d97-a814-b0887891a7e4]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:09:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCkGRVxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "interface-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "interface-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.objects.instance [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'flavor' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.network.neutron [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updated VIF entry in instance network info cache for port ce8e302f-1f0b-46e0-82ef-9809a6ad81db. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.network.neutron [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updating instance_info_cache with network_info: [{"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8c00650a-3e08-4317-8d70-c260166209e5 req-ec159133-b7eb-4ddd-8d31-7e85940f6f7b service nova] Releasing lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.objects.instance [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'pci_requests' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.network.neutron [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.policy [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b59f4d6492a4821a621b18766bf58fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23bf27d7ed4f0abf2fdc60ae1edb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26232626262616538', 'path': '/dev/sdf'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232626262616538', 'path': '/dev/sdf'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'flavor' on Instance uuid 1be0a3f9-0dae-4739-9f1e-0bb416a97719 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:09:59 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:09:59 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:09:59 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:09:59 user nova-compute[71507]:   <serial>d6ada0a7-ffdb-481e-a557-ba3dec80ef65</serial>
Apr 13 15:09:59 user nova-compute[71507]: </disk>
Apr 13 15:09:59 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:09:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] No VIF found with MAC fa:16:3e:3b:11:e1, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398584.999966, 63f69337-7ae4-4125-a560-f6cbcb2298d4 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:10:00 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] VM Stopped (Lifecycle Event)
Apr 13 15:10:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Successfully created port: f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8900f123-fc97-4973-b5f0-fcb8cb5160e7 None None] [instance: 63f69337-7ae4-4125-a560-f6cbcb2298d4] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d390ab30-01ce-4b84-8ab4-b01558b69b85 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.679s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG nova.objects.instance [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lazy-loading 'flavor' on Instance uuid 051e6c4e-3d10-4b43-9099-7abffd84d0d9 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2fa262e6-8dfa-478a-8e2a-435fee4f3ca5 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.574s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Successfully updated port: f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquired lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-changed-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Refreshing instance network info cache due to event network-changed-f9729e1e-db88-4e50-bc31-f2ad9a568084. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] Acquiring lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZexjymJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:00 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:00 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:00 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81f9e6b-528d-4816-abb3-bf8c09f2944c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:10:00 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee738f-d0e6-438c-a2a6-905df076eb62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d] added
Apr 13 15:10:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b335c6-2fa3-4168-af32-7778cb166c1b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[97516d01-b90b-4f42-bc8e-c6465754ad89]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZexjymJV {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZexjymJV" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3b436f-a251-4491-b4c7-6d32015d7ebd]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZexjymJV'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46e465-56e2-4e76-a9cc-bfa1ac0f0c04]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d0d211-a2c7-4fe9-b8fe-b42929caa0fe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:00 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:00 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:00 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:00 user nova-compute[71507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)
Apr 13 15:10:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:00 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:00 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:00 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:00 user nova-compute[71507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)
Apr 13 15:10:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eb181f-ce0f-4a88-93b8-b9483cf19a9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260]
Apr 13 15:10:01 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[022c8c77-5400-4d7f-ac20-ad2c7c9def03]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1d4edd-7097-427a-9979-d4b612f8207f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)
Apr 13 15:10:01 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[329d9919-6afd-43d8-ab68-0cab71b7a40c]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZexjymJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:01 user nova-compute[71507]: INFO nova.compute.manager [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Detaching volume d6ada0a7-ffdb-481e-a557-ba3dec80ef65
Apr 13 15:10:01 user nova-compute[71507]: INFO nova.virt.block_device [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Attempting to driver detach volume d6ada0a7-ffdb-481e-a557-ba3dec80ef65 from mountpoint /dev/vdb
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Attempting to detach device vdb from instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:10:01 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:10:01 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:10:01 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:10:01 user nova-compute[71507]:   <serial>d6ada0a7-ffdb-481e-a557-ba3dec80ef65</serial>
Apr 13 15:10:01 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:10:01 user nova-compute[71507]: </disk>
Apr 13 15:10:01 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:10:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Successfully detached device vdb from instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 from the persistent domain config.
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:10:01 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:10:01 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:10:01 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:10:01 user nova-compute[71507]:   <serial>d6ada0a7-ffdb-481e-a557-ba3dec80ef65</serial>
Apr 13 15:10:01 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:10:01 user nova-compute[71507]: </disk>
Apr 13 15:10:01 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updating instance_info_cache with network_info: [{"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Releasing lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] Acquired lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.network.neutron [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Refreshing network info cache for port f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055562483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2055562483',id=10,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A==',key_name='tempest-keypair-1905935028',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='be23bf27d7ed4f0abf2fdc60ae1edb71',ramdisk_id='',reservation_id='r-wj2y7pak',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-227294207',owner_user_name='tempest-TaggedAttachmentsTest-227294207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b59f4d6492a4821a621b18766bf58fa',uuid=95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converting VIF {"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_vif [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9729e1e-db, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9729e1e-db, col_values=(('external_ids', {'iface-id': 'f9729e1e-db88-4e50-bc31-f2ad9a568084', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:75:b5', 'vm-uuid': '95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:01 user nova-compute[71507]: INFO os_vif [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db')
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055562483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2055562483',id=10,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A==',key_name='tempest-keypair-1905935028',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='be23bf27d7ed4f0abf2fdc60ae1edb71',ramdisk_id='',reservation_id='r-wj2y7pak',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-227294207',owner_user_name='tempest-TaggedAttachmentsTest-227294207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b59f4d6492a4821a621b18766bf58fa',uuid=95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converting VIF {"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] attach device xml: <interface type="ethernet">
Apr 13 15:10:01 user nova-compute[71507]:   <mac address="fa:16:3e:e6:75:b5"/>
Apr 13 15:10:01 user nova-compute[71507]:   <model type="virtio"/>
Apr 13 15:10:01 user nova-compute[71507]:   <mtu size="1442"/>
Apr 13 15:10:01 user nova-compute[71507]:   <target dev="tapf9729e1e-db"/>
Apr 13 15:10:01 user nova-compute[71507]: </interface>
Apr 13 15:10:01 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681398601.7572632, 1be0a3f9-0dae-4739-9f1e-0bb416a97719 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:10:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Successfully detached device vdb from instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 from the live domain config.
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCkGRVxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:01 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:01 user nova-compute[71507]: INFO nova.compute.manager [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Terminating instance
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-plugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] No waiting events found dispatching network-vif-plugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:01 user nova-compute[71507]: WARNING nova.compute.manager [req-30193e3c-2bf9-4fb6-b972-514dbd793dc4 req-e3c4ab36-efc9-442d-9a07-9a7d63361b22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received unexpected event network-vif-plugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance with vm_state active and task_state None.
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updated VIF entry in instance network info cache for port f9729e1e-db88-4e50-bc31-f2ad9a568084. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updating instance_info_cache with network_info: [{"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fc50e0d4-bceb-437a-8e63-1775ed1080ca req-e1f6b439-6345-4932-a4b4-53d30ae2a08f service nova] Releasing lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] No BDM found with device name hda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] No VIF found with MAC fa:16:3e:cd:1d:8a, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23266643462393061', 'path': '/dev/sdg'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266643462393061', 'path': '/dev/sdg'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.389s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lazy-loading 'flavor' on Instance uuid 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:02 user nova-compute[71507]:   <nova:package version="0.0.0"/>
Apr 13 15:10:02 user nova-compute[71507]:   <nova:name>tempest-device-tagging-server-2055562483</nova:name>
Apr 13 15:10:02 user nova-compute[71507]:   <nova:creationTime>2023-04-13 15:10:02</nova:creationTime>
Apr 13 15:10:02 user nova-compute[71507]:   <nova:flavor name="m1.nano">
Apr 13 15:10:02 user nova-compute[71507]:     <nova:memory>128</nova:memory>
Apr 13 15:10:02 user nova-compute[71507]:     <nova:disk>1</nova:disk>
Apr 13 15:10:02 user nova-compute[71507]:     <nova:swap>0</nova:swap>
Apr 13 15:10:02 user nova-compute[71507]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:02 user nova-compute[71507]:     <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:02 user nova-compute[71507]:   </nova:flavor>
Apr 13 15:10:02 user nova-compute[71507]:   <nova:owner>
Apr 13 15:10:02 user nova-compute[71507]:     <nova:user uuid="5b59f4d6492a4821a621b18766bf58fa">tempest-TaggedAttachmentsTest-227294207-project-member</nova:user>
Apr 13 15:10:02 user nova-compute[71507]:     <nova:project uuid="be23bf27d7ed4f0abf2fdc60ae1edb71">tempest-TaggedAttachmentsTest-227294207</nova:project>
Apr 13 15:10:02 user nova-compute[71507]:   </nova:owner>
Apr 13 15:10:02 user nova-compute[71507]:   <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:02 user nova-compute[71507]:   <nova:ports>
Apr 13 15:10:02 user nova-compute[71507]:     <nova:port uuid="ce8e302f-1f0b-46e0-82ef-9809a6ad81db">
Apr 13 15:10:02 user nova-compute[71507]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:10:02 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:02 user nova-compute[71507]:     <nova:port uuid="f9729e1e-db88-4e50-bc31-f2ad9a568084">
Apr 13 15:10:02 user nova-compute[71507]:       <nova:ip type="fixed" address="10.10.10.222" ipVersion="4"/>
Apr 13 15:10:02 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:02 user nova-compute[71507]:   </nova:ports>
Apr 13 15:10:02 user nova-compute[71507]: </nova:instance>
Apr 13 15:10:02 user nova-compute[71507]:  {{(pid=71507) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cfd956-38cc-40be-a507-d48ebf882d06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:10:02 user nova-compute[71507]: No targets found.
Apr 13 15:10:02 user nova-compute[71507]: iSNS:
Apr 13 15:10:02 user nova-compute[71507]: No targets found.
Apr 13 15:10:02 user nova-compute[71507]: STATIC:
Apr 13 15:10:02 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65
Apr 13 15:10:02 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:02 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:02 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d
Apr 13 15:10:02 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:02 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:02 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece
Apr 13 15:10:02 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:02 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:02 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a
Apr 13 15:10:02 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:02 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:02 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6
Apr 13 15:10:02 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:02 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:02 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:10:02 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:02 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:02 user nova-compute[71507]: FIRMWARE:
Apr 13 15:10:02 user nova-compute[71507]: No targets found.
Apr 13 15:10:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:10:02 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:10:02 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:10:02 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:10:02 user nova-compute[71507]:   <source dev="/dev/sdg"/>
Apr 13 15:10:02 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:10:02 user nova-compute[71507]:   <serial>3c648678-ad4b-4ce5-b267-ebf3abef2c5d</serial>
Apr 13 15:10:02 user nova-compute[71507]: </disk>
Apr 13 15:10:02 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cd19ff-6531-4028-9351-2cab6ea67efd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-200815f3-7262-4015-82d9-924f9ebccb17 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "interface-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.225s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f30ec8-a89e-4d82-b303-d7aaed96948f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 (non-flash)
Apr 13 15:10:02 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1d7a7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65'): ({'sdf'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Removing single pathed devices sdf {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1b7910-7a1a-417c-843a-b83120a25c01]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0cc45d-0b95-4816-9837-78ca8e88a01d]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Flushing IO for device /dev/sdf {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e730539d-18a4-46bb-8312-e413d9cfe5f3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc2012-5869-4738-aae8-2138b1c479b0]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb04c5f4-d009-45ec-abeb-76c2ce4aa355]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebc6070-1e3e-4b46-8b3b-66bfda0aed81]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65, portal: 172.16.0.220,3260]
Apr 13 15:10:02 user nova-compute[71507]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6ada0a7-ffdb-481e-a557-ba3dec80ef65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa806f8-6f1e-4970-b6c0-cf61152b0cc3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] <== disconnect_volume: return (765ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'flavor' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:02 user nova-compute[71507]: INFO nova.compute.manager [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Attaching volume e7bf84ee-99d9-4818-9538-c1f3a2818935 to /dev/vdb
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.utils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Instance destroyed successfully.
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lazy-loading 'resources' on Instance uuid 051e6c4e-3d10-4b43-9099-7abffd84d0d9 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf255bf-9df8-4dbd-b038-60100d06e74d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-147617088',display_name='tempest-AttachSCSIVolumeTestJSON-server-147617088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-147617088',id=6,image_ref='1b4e800e-2bfa-417d-a618-befe946371e7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdE6pt2CSkI/kEMmDhNZ34i6Ws4BJ7Wxj9caFRRNEIYDhqeJqqwyQIDLqWtH2pzCVO74K73+FxMAYZGQKcysukCtq7qljnX22uMPUb/pbYlx+SVYyeT77SFJp2ybY8vxQ==',key_name='tempest-keypair-815100895',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89fbef55fb3c43d69af48208d28c87f0',ramdisk_id='',reservation_id='r-eddvxk1i',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1b4e800e-2bfa-417d-a618-befe946371e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-264698011',owner_user_name='tempest-AttachSCSIVolumeTestJSON-264698011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6747b03238c481d836caaf583f20a16',uuid=051e6c4e-3d10-4b43-9099-7abffd84d0d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Converting VIF {"id": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "address": "fa:16:3e:93:68:92", "network": {"id": "c4a62646-4713-4fec-aef2-21b4c00c534f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1207975286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89fbef55fb3c43d69af48208d28c87f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33a9384-ad", "ovs_interfaceid": "a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:68:92,bridge_name='br-int',has_traffic_filtering=True,id=a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f,network=Network(c4a62646-4713-4fec-aef2-21b4c00c534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33a9384-ad') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_vif [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:68:92,bridge_name='br-int',has_traffic_filtering=True,id=a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f,network=Network(c4a62646-4713-4fec-aef2-21b4c00c534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33a9384-ad') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa33a9384-ad, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8fcb87-b720-4eb8-8d67-def1d8f5ffe9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: INFO os_vif [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:68:92,bridge_name='br-int',has_traffic_filtering=True,id=a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f,network=Network(c4a62646-4713-4fec-aef2-21b4c00c534f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33a9384-ad')
Apr 13 15:10:02 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Deleting instance files /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9_del
Apr 13 15:10:02 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Deletion of /opt/stack/data/nova/instances/051e6c4e-3d10-4b43-9099-7abffd84d0d9_del complete
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1b8575-24dd-4e58-8084-b45ecc0ed6ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aad769-4706-4db7-bb8f-c38800ff9179]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] No VIF found with MAC fa:16:3e:6e:39:0d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:10:02 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[04386676-552c-4fca-907a-ad94da2832db]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:02 user nova-compute[71507]: INFO nova.compute.manager [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 13 15:10:02 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG os_brick.utils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updating existing volume attachment record: f1458358-cdf4-4276-8c28-6650258b4cf2 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7576016a-2482-4aa8-ad02-7a2ba8d4d972 tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.731s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'flavor' on Instance uuid 1be0a3f9-0dae-4739-9f1e-0bb416a97719 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5633251d-b79a-4547-b845-0bd38ba3c76f tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.227s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-plugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] No waiting events found dispatching network-vif-plugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:03 user nova-compute[71507]: WARNING nova.compute.manager [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received unexpected event network-vif-plugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance with vm_state active and task_state None.
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received event network-vif-unplugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] No waiting events found dispatching network-vif-unplugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received event network-vif-unplugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received event network-vif-plugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Acquiring lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] No waiting events found dispatching network-vif-plugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:04 user nova-compute[71507]: WARNING nova.compute.manager [req-962f5ae3-92b8-4bd8-a554-9a5e1d12151b req-8ed2cde5-2c94-4593-9ddf-d06bbb54493a service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received unexpected event network-vif-plugged-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f for instance with vm_state active and task_state deleting.
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG os_brick.utils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6654f797-6927-4bee-96ed-9f8729ee66f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Received event network-vif-deleted-a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:04 user nova-compute[71507]: INFO nova.compute.manager [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Neutron deleted interface a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f; detaching it from the instance and deleting it from the info cache
Apr 13 15:10:04 user nova-compute[71507]: DEBUG nova.network.neutron [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abdac13-d76f-45a2-9ca0-4565873acf77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:04 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Took 1.11 seconds to deallocate network for instance.
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3fb574-8a26-40b8-9daf-37e637df045f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[213a7c99-2ce1-439d-822d-b22b3cf303f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-3250c97b-7da6-4696-9d8d-777db32c48f2 req-85594f2c-8ed6-471d-94ac-805c544f4bef service nova] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Detach interface failed, port_id=a33a9384-ad3d-4f9d-9117-7d4a7ac06d5f, reason: Instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9 could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:10:04 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c31cac-eea3-4d9e-8dc7-cc1a4762a893]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG os_brick.utils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:04 user nova-compute[71507]: INFO nova.compute.manager [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Swapping volume 3c648678-ad4b-4ce5-b267-ebf3abef2c5d for 13c8ec19-b219-44c8-9c72-1a5a06e96d91
Apr 13 15:10:04 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:04 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Deleted allocations for instance 051e6c4e-3d10-4b43-9099-7abffd84d0d9
Apr 13 15:10:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c4e963bc-449d-4903-b5c5-ade2342c5276 tempest-AttachSCSIVolumeTestJSON-264698011 tempest-AttachSCSIVolumeTestJSON-264698011-project-member] Lock "051e6c4e-3d10-4b43-9099-7abffd84d0d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.156s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saxuhdLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:10 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:10 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:10 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48fed6f-c01b-4267-a4f2-4a464c306a4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:10:10 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98cbf3a-88a4-48ae-882e-3ae2844c1f9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935] added
Apr 13 15:10:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fef433-bfd4-45e5-bf90-c9ccef180d23]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ed739f-29b3-4715-8edb-958250c143db]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saxuhdLD {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saxuhdLD" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8e8ad1-7991-4af0-ae3b-3c14f417a658]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'saxuhdLD'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f3713b-bb11-4a92-9cf4-11e01394f278]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2aeb61-2e54-4228-a564-01a1c72a5fe9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c15e9b8-2737-4cca-9d87-ef47b691744d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935, portal: 172.16.0.220,3260]
Apr 13 15:10:10 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4738bf9-1a48-41ba-90df-c7fa2e89c90d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec22e2e-7c0e-425e-9aa9-1af8cca6e735]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:10 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ba62d2-c1f2-4bdd-a2f5-4eac4b390ce8]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saxuhdLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23033376362656261', 'path': '/dev/sdf'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033376362656261', 'path': '/dev/sdf'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'flavor' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:10:11 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:10:11 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:10:11 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:10:11 user nova-compute[71507]:   <serial>e7bf84ee-99d9-4818-9538-c1f3a2818935</serial>
Apr 13 15:10:11 user nova-compute[71507]: </disk>
Apr 13 15:10:11 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfvqpXCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '193136fc-e6c3-4e70-b7ab-01ced440c6bd', 'attached_at': '', 'detached_at': '', 'volume_id': '13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'serial': '13c8ec19-b219-44c8-9c72-1a5a06e96d91'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZexjymJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '193136fc-e6c3-4e70-b7ab-01ced440c6bd', 'attached_at': '', 'detached_at': '', 'volume_id': '3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'serial'} {{(pid=71507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfvqpXCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:11 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:11 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:11 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac120c4-6ce6-4eca-af6a-1a9689e4e706]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:10:11 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e7bba4-652a-4905-bbc0-3b673ea1a586]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91] added
Apr 13 15:10:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac0b0dd-8d68-42e4-9159-e65687fb28d2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a671ecb-1ed7-4ec0-8508-a5def9d17736]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AfvqpXCN {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AfvqpXCN" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef0b8c3-4300-4f02-acc7-0bab8c0bb1e7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AfvqpXCN'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[088c5107-a828-42ce-a48d-d4b62472326b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[322c66d5-4280-4f0e-a71a-1a6fb3709fa2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4b5bba-62d0-4346-82db-5e85b32bc9f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91, portal: 172.16.0.220,3260]
Apr 13 15:10:11 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e938bb6-0cf2-4434-acc2-a697c5df703b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c7bd4b-07a1-490f-b61c-3a9a626b8d37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:11 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8957163c-6607-44df-941a-cf8b5e4c263e]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:10:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfvqpXCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] No BDM found with device name hda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] No VIF found with MAC fa:16:3e:cd:1d:8a, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c0372b33-5f13-4cec-97be-5af55151509e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.398s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:12 user nova-compute[71507]: INFO nova.compute.manager [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Detaching volume e7bf84ee-99d9-4818-9538-c1f3a2818935
Apr 13 15:10:12 user nova-compute[71507]: INFO nova.virt.block_device [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Attempting to driver detach volume e7bf84ee-99d9-4818-9538-c1f3a2818935 from mountpoint /dev/vdb
Apr 13 15:10:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Attempting to detach device vdb from instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:10:12 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:10:12 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:10:12 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:10:12 user nova-compute[71507]:   <serial>e7bf84ee-99d9-4818-9538-c1f3a2818935</serial>
Apr 13 15:10:12 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 15:10:12 user nova-compute[71507]: </disk>
Apr 13 15:10:12 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23036363261303562', 'path': '/dev/sdh'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036363261303562', 'path': '/dev/sdh'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:10:13 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Successfully detached device vdb from instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc from the persistent domain config.
Apr 13 15:10:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:10:13 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:10:13 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:10:13 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:10:13 user nova-compute[71507]:   <serial>e7bf84ee-99d9-4818-9538-c1f3a2818935</serial>
Apr 13 15:10:13 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 15:10:13 user nova-compute[71507]: </disk>
Apr 13 15:10:13 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG nova.objects.instance [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lazy-loading 'flavor' on Instance uuid 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681398613.7278955, 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:10:13 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Successfully detached device vdb from instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc from the live domain config.
Apr 13 15:10:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saxuhdLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:13 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[46be371d-f4c6-4953-98b8-24bd99b30df3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:10:13 user nova-compute[71507]: No targets found.
Apr 13 15:10:13 user nova-compute[71507]: iSNS:
Apr 13 15:10:13 user nova-compute[71507]: No targets found.
Apr 13 15:10:13 user nova-compute[71507]: STATIC:
Apr 13 15:10:13 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d
Apr 13 15:10:13 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:13 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:13 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935
Apr 13 15:10:13 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:13 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:13 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece
Apr 13 15:10:13 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:13 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:13 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91
Apr 13 15:10:13 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:13 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:13 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a
Apr 13 15:10:13 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:13 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:13 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6
Apr 13 15:10:13 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:13 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:13 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:10:13 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:13 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:13 user nova-compute[71507]: FIRMWARE:
Apr 13 15:10:13 user nova-compute[71507]: No targets found.
Apr 13 15:10:13 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:10:13 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:10:13 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0d777a-39a4-4d53-b44e-c993da09c4a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32e357a-21ca-4cda-a31f-efbf57c20e4b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:13 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:13 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:13 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c6609d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935'): ({'sdf'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Removing single pathed devices sdf {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3678ffd0-6601-4ecd-8bcd-fc9600dcd12f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b858d0e2-d76c-4f98-aed9-067cc35d760b]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Flushing IO for device /dev/sdf {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 113246208 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e953dab-1771-494c-a63d-20a716d86aed]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:10:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e676c32-f9ad-46ef-8c26-cc7311dca354]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cf2528-b531-4d6c-a427-3a04a273c808]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e741b164-9e97-416a-9811-6fb1c7241bc7]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935, portal: 172.16.0.220,3260]
Apr 13 15:10:14 user nova-compute[71507]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:14 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7bf84ee-99d9-4818-9538-c1f3a2818935 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dad87f-5bf4-4ecb-a2f5-92780057e775]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] <== disconnect_volume: return (427ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 283115520 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 384827392 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:15 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'flavor' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab27aafc-e06f-40f3-aa5b-78521bb7b488 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.383s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 529530880 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 707788800 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-changed-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing instance network info cache due to event network-changed-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] Acquiring lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] Acquired lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.network.neutron [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Refreshing network info cache for port 6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "interface-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-f9729e1e-db88-4e50-bc31-f2ad9a568084" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "interface-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-f9729e1e-db88-4e50-bc31-f2ad9a568084" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'flavor' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055562483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2055562483',id=10,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A==',key_name='tempest-keypair-1905935028',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be23bf27d7ed4f0abf2fdc60ae1edb71',ramdisk_id='',reservation_id='r-wj2y7pak',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-227294207',owner_user_name='tempest-TaggedAttachmentsTest-227294207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b59f4d6492a4821a621b18766bf58fa',uuid=95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converting VIF {"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface> {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface> {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Attempting to detach device tapf9729e1e-db from instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] detach device xml: <interface type="ethernet">
Apr 13 15:10:16 user nova-compute[71507]:   <mac address="fa:16:3e:e6:75:b5"/>
Apr 13 15:10:16 user nova-compute[71507]:   <model type="virtio"/>
Apr 13 15:10:16 user nova-compute[71507]:   <mtu size="1442"/>
Apr 13 15:10:16 user nova-compute[71507]:   <target dev="tapf9729e1e-db"/>
Apr 13 15:10:16 user nova-compute[71507]: </interface>
Apr 13 15:10:16 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface> {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 13 15:10:16 user nova-compute[71507]:   <name>instance-0000000a</name>
Apr 13 15:10:16 user nova-compute[71507]:   <uuid>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</uuid>
Apr 13 15:10:16 user nova-compute[71507]:   <metadata>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:16 user nova-compute[71507]:   <nova:package version="0.0.0"/>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:name>tempest-device-tagging-server-2055562483</nova:name>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:creationTime>2023-04-13 15:10:02</nova:creationTime>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:flavor name="m1.nano">
Apr 13 15:10:16 user nova-compute[71507]:     <nova:memory>128</nova:memory>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:disk>1</nova:disk>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:swap>0</nova:swap>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:16 user nova-compute[71507]:   </nova:flavor>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:owner>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:user uuid="5b59f4d6492a4821a621b18766bf58fa">tempest-TaggedAttachmentsTest-227294207-project-member</nova:user>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:project uuid="be23bf27d7ed4f0abf2fdc60ae1edb71">tempest-TaggedAttachmentsTest-227294207</nova:project>
Apr 13 15:10:16 user nova-compute[71507]:   </nova:owner>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:ports>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:port uuid="ce8e302f-1f0b-46e0-82ef-9809a6ad81db">
Apr 13 15:10:16 user nova-compute[71507]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:10:16 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:port uuid="f9729e1e-db88-4e50-bc31-f2ad9a568084">
Apr 13 15:10:16 user nova-compute[71507]:       <nova:ip type="fixed" address="10.10.10.222" ipVersion="4"/>
Apr 13 15:10:16 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:16 user nova-compute[71507]:   </nova:ports>
Apr 13 15:10:16 user nova-compute[71507]: </nova:instance>
Apr 13 15:10:16 user nova-compute[71507]:   </metadata>
Apr 13 15:10:16 user nova-compute[71507]:   <memory unit='KiB'>131072</memory>
Apr 13 15:10:16 user nova-compute[71507]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 15:10:16 user nova-compute[71507]:   <vcpu placement='static'>1</vcpu>
Apr 13 15:10:16 user nova-compute[71507]:   <resource>
Apr 13 15:10:16 user nova-compute[71507]:     <partition>/machine</partition>
Apr 13 15:10:16 user nova-compute[71507]:   </resource>
Apr 13 15:10:16 user nova-compute[71507]:   <sysinfo type='smbios'>
Apr 13 15:10:16 user nova-compute[71507]:     <system>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='version'>0.0.0</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='serial'>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='uuid'>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='family'>Virtual Machine</entry>
Apr 13 15:10:16 user nova-compute[71507]:     </system>
Apr 13 15:10:16 user nova-compute[71507]:   </sysinfo>
Apr 13 15:10:16 user nova-compute[71507]:   <os>
Apr 13 15:10:16 user nova-compute[71507]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 15:10:16 user nova-compute[71507]:     <boot dev='hd'/>
Apr 13 15:10:16 user nova-compute[71507]:     <smbios mode='sysinfo'/>
Apr 13 15:10:16 user nova-compute[71507]:   </os>
Apr 13 15:10:16 user nova-compute[71507]:   <features>
Apr 13 15:10:16 user nova-compute[71507]:     <acpi/>
Apr 13 15:10:16 user nova-compute[71507]:     <apic/>
Apr 13 15:10:16 user nova-compute[71507]:     <vmcoreinfo state='on'/>
Apr 13 15:10:16 user nova-compute[71507]:   </features>
Apr 13 15:10:16 user nova-compute[71507]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 15:10:16 user nova-compute[71507]:     <model fallback='forbid'>Nehalem</model>
Apr 13 15:10:16 user nova-compute[71507]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 15:10:16 user nova-compute[71507]:     <feature policy='require' name='vme'/>
Apr 13 15:10:16 user nova-compute[71507]:     <feature policy='require' name='x2apic'/>
Apr 13 15:10:16 user nova-compute[71507]:     <feature policy='require' name='hypervisor'/>
Apr 13 15:10:16 user nova-compute[71507]:   </cpu>
Apr 13 15:10:16 user nova-compute[71507]:   <clock offset='utc'>
Apr 13 15:10:16 user nova-compute[71507]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 15:10:16 user nova-compute[71507]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 15:10:16 user nova-compute[71507]:     <timer name='hpet' present='no'/>
Apr 13 15:10:16 user nova-compute[71507]:   </clock>
Apr 13 15:10:16 user nova-compute[71507]:   <on_poweroff>destroy</on_poweroff>
Apr 13 15:10:16 user nova-compute[71507]:   <on_reboot>restart</on_reboot>
Apr 13 15:10:16 user nova-compute[71507]:   <on_crash>destroy</on_crash>
Apr 13 15:10:16 user nova-compute[71507]:   <devices>
Apr 13 15:10:16 user nova-compute[71507]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 15:10:16 user nova-compute[71507]:     <disk type='file' device='disk'>
Apr 13 15:10:16 user nova-compute[71507]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 15:10:16 user nova-compute[71507]:       <source file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk' index='2'/>
Apr 13 15:10:16 user nova-compute[71507]:       <backingStore type='file' index='3'>
Apr 13 15:10:16 user nova-compute[71507]:         <format type='raw'/>
Apr 13 15:10:16 user nova-compute[71507]:         <source file='/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918'/>
Apr 13 15:10:16 user nova-compute[71507]:         <backingStore/>
Apr 13 15:10:16 user nova-compute[71507]:       </backingStore>
Apr 13 15:10:16 user nova-compute[71507]:       <target dev='vda' bus='virtio'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='virtio-disk0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </disk>
Apr 13 15:10:16 user nova-compute[71507]:     <disk type='file' device='cdrom'>
Apr 13 15:10:16 user nova-compute[71507]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 15:10:16 user nova-compute[71507]:       <source file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.config' index='1'/>
Apr 13 15:10:16 user nova-compute[71507]:       <backingStore/>
Apr 13 15:10:16 user nova-compute[71507]:       <target dev='hda' bus='ide'/>
Apr 13 15:10:16 user nova-compute[71507]:       <readonly/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='ide0-0-0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </disk>
Apr 13 15:10:16 user nova-compute[71507]:     <controller type='usb' index='0' model='none'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='usb'/>
Apr 13 15:10:16 user nova-compute[71507]:     </controller>
Apr 13 15:10:16 user nova-compute[71507]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='pci.0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </controller>
Apr 13 15:10:16 user nova-compute[71507]:     <controller type='ide' index='0'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='ide'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 15:10:16 user nova-compute[71507]:     </controller>
Apr 13 15:10:16 user nova-compute[71507]:     <interface type='ethernet'>
Apr 13 15:10:16 user nova-compute[71507]:       <mac address='fa:16:3e:cd:1d:8a'/>
Apr 13 15:10:16 user nova-compute[71507]:       <target dev='tapce8e302f-1f'/>
Apr 13 15:10:16 user nova-compute[71507]:       <model type='virtio'/>
Apr 13 15:10:16 user nova-compute[71507]:       <mtu size='1442'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='net0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </interface>
Apr 13 15:10:16 user nova-compute[71507]:     <interface type='ethernet'>
Apr 13 15:10:16 user nova-compute[71507]:       <mac address='fa:16:3e:e6:75:b5'/>
Apr 13 15:10:16 user nova-compute[71507]:       <target dev='tapf9729e1e-db'/>
Apr 13 15:10:16 user nova-compute[71507]:       <model type='virtio'/>
Apr 13 15:10:16 user nova-compute[71507]:       <mtu size='1442'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='net1'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </interface>
Apr 13 15:10:16 user nova-compute[71507]:     <serial type='pty'>
Apr 13 15:10:16 user nova-compute[71507]:       <source path='/dev/pts/9'/>
Apr 13 15:10:16 user nova-compute[71507]:       <log file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log' append='off'/>
Apr 13 15:10:16 user nova-compute[71507]:       <target type='isa-serial' port='0'>
Apr 13 15:10:16 user nova-compute[71507]:         <model name='isa-serial'/>
Apr 13 15:10:16 user nova-compute[71507]:       </target>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='serial0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </serial>
Apr 13 15:10:16 user nova-compute[71507]:     <console type='pty' tty='/dev/pts/9'>
Apr 13 15:10:16 user nova-compute[71507]:       <source path='/dev/pts/9'/>
Apr 13 15:10:16 user nova-compute[71507]:       <log file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log' append='off'/>
Apr 13 15:10:16 user nova-compute[71507]:       <target type='serial' port='0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='serial0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </console>
Apr 13 15:10:16 user nova-compute[71507]:     <input type='mouse' bus='ps2'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='input0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </input>
Apr 13 15:10:16 user nova-compute[71507]:     <input type='keyboard' bus='ps2'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='input1'/>
Apr 13 15:10:16 user nova-compute[71507]:     </input>
Apr 13 15:10:16 user nova-compute[71507]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 13 15:10:16 user nova-compute[71507]:       <listen type='address' address='0.0.0.0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </graphics>
Apr 13 15:10:16 user nova-compute[71507]:     <audio id='1' type='none'/>
Apr 13 15:10:16 user nova-compute[71507]:     <video>
Apr 13 15:10:16 user nova-compute[71507]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='video0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </video>
Apr 13 15:10:16 user nova-compute[71507]:     <memballoon model='virtio'>
Apr 13 15:10:16 user nova-compute[71507]:       <stats period='10'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='balloon0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </memballoon>
Apr 13 15:10:16 user nova-compute[71507]:     <rng model='virtio'>
Apr 13 15:10:16 user nova-compute[71507]:       <backend model='random'>/dev/urandom</backend>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='rng0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </rng>
Apr 13 15:10:16 user nova-compute[71507]:   </devices>
Apr 13 15:10:16 user nova-compute[71507]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 15:10:16 user nova-compute[71507]:     <label>libvirt-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</label>
Apr 13 15:10:16 user nova-compute[71507]:     <imagelabel>libvirt-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</imagelabel>
Apr 13 15:10:16 user nova-compute[71507]:   </seclabel>
Apr 13 15:10:16 user nova-compute[71507]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 15:10:16 user nova-compute[71507]:     <label>+64055:+108</label>
Apr 13 15:10:16 user nova-compute[71507]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 15:10:16 user nova-compute[71507]:   </seclabel>
Apr 13 15:10:16 user nova-compute[71507]: </domain>
Apr 13 15:10:16 user nova-compute[71507]:  {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 15:10:16 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Successfully detached device tapf9729e1e-db from instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc from the persistent domain config.
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] (1/8): Attempting to detach device tapf9729e1e-db with device alias net1 from instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] detach device xml: <interface type="ethernet">
Apr 13 15:10:16 user nova-compute[71507]:   <mac address="fa:16:3e:e6:75:b5"/>
Apr 13 15:10:16 user nova-compute[71507]:   <model type="virtio"/>
Apr 13 15:10:16 user nova-compute[71507]:   <mtu size="1442"/>
Apr 13 15:10:16 user nova-compute[71507]:   <target dev="tapf9729e1e-db"/>
Apr 13 15:10:16 user nova-compute[71507]: </interface>
Apr 13 15:10:16 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 873463808 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681398616.635024, 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Start waiting for the detach event from libvirt for device tapf9729e1e-db with device alias net1 for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface> {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 13 15:10:16 user nova-compute[71507]:   <name>instance-0000000a</name>
Apr 13 15:10:16 user nova-compute[71507]:   <uuid>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</uuid>
Apr 13 15:10:16 user nova-compute[71507]:   <metadata>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:16 user nova-compute[71507]:   <nova:package version="0.0.0"/>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:name>tempest-device-tagging-server-2055562483</nova:name>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:creationTime>2023-04-13 15:10:02</nova:creationTime>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:flavor name="m1.nano">
Apr 13 15:10:16 user nova-compute[71507]:     <nova:memory>128</nova:memory>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:disk>1</nova:disk>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:swap>0</nova:swap>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:16 user nova-compute[71507]:   </nova:flavor>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:owner>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:user uuid="5b59f4d6492a4821a621b18766bf58fa">tempest-TaggedAttachmentsTest-227294207-project-member</nova:user>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:project uuid="be23bf27d7ed4f0abf2fdc60ae1edb71">tempest-TaggedAttachmentsTest-227294207</nova:project>
Apr 13 15:10:16 user nova-compute[71507]:   </nova:owner>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:ports>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:port uuid="ce8e302f-1f0b-46e0-82ef-9809a6ad81db">
Apr 13 15:10:16 user nova-compute[71507]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:10:16 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:port uuid="f9729e1e-db88-4e50-bc31-f2ad9a568084">
Apr 13 15:10:16 user nova-compute[71507]:       <nova:ip type="fixed" address="10.10.10.222" ipVersion="4"/>
Apr 13 15:10:16 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:16 user nova-compute[71507]:   </nova:ports>
Apr 13 15:10:16 user nova-compute[71507]: </nova:instance>
Apr 13 15:10:16 user nova-compute[71507]:   </metadata>
Apr 13 15:10:16 user nova-compute[71507]:   <memory unit='KiB'>131072</memory>
Apr 13 15:10:16 user nova-compute[71507]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 15:10:16 user nova-compute[71507]:   <vcpu placement='static'>1</vcpu>
Apr 13 15:10:16 user nova-compute[71507]:   <resource>
Apr 13 15:10:16 user nova-compute[71507]:     <partition>/machine</partition>
Apr 13 15:10:16 user nova-compute[71507]:   </resource>
Apr 13 15:10:16 user nova-compute[71507]:   <sysinfo type='smbios'>
Apr 13 15:10:16 user nova-compute[71507]:     <system>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='version'>0.0.0</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='serial'>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='uuid'>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:10:16 user nova-compute[71507]:       <entry name='family'>Virtual Machine</entry>
Apr 13 15:10:16 user nova-compute[71507]:     </system>
Apr 13 15:10:16 user nova-compute[71507]:   </sysinfo>
Apr 13 15:10:16 user nova-compute[71507]:   <os>
Apr 13 15:10:16 user nova-compute[71507]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 15:10:16 user nova-compute[71507]:     <boot dev='hd'/>
Apr 13 15:10:16 user nova-compute[71507]:     <smbios mode='sysinfo'/>
Apr 13 15:10:16 user nova-compute[71507]:   </os>
Apr 13 15:10:16 user nova-compute[71507]:   <features>
Apr 13 15:10:16 user nova-compute[71507]:     <acpi/>
Apr 13 15:10:16 user nova-compute[71507]:     <apic/>
Apr 13 15:10:16 user nova-compute[71507]:     <vmcoreinfo state='on'/>
Apr 13 15:10:16 user nova-compute[71507]:   </features>
Apr 13 15:10:16 user nova-compute[71507]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 15:10:16 user nova-compute[71507]:     <model fallback='forbid'>Nehalem</model>
Apr 13 15:10:16 user nova-compute[71507]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 15:10:16 user nova-compute[71507]:     <feature policy='require' name='vme'/>
Apr 13 15:10:16 user nova-compute[71507]:     <feature policy='require' name='x2apic'/>
Apr 13 15:10:16 user nova-compute[71507]:     <feature policy='require' name='hypervisor'/>
Apr 13 15:10:16 user nova-compute[71507]:   </cpu>
Apr 13 15:10:16 user nova-compute[71507]:   <clock offset='utc'>
Apr 13 15:10:16 user nova-compute[71507]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 15:10:16 user nova-compute[71507]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 15:10:16 user nova-compute[71507]:     <timer name='hpet' present='no'/>
Apr 13 15:10:16 user nova-compute[71507]:   </clock>
Apr 13 15:10:16 user nova-compute[71507]:   <on_poweroff>destroy</on_poweroff>
Apr 13 15:10:16 user nova-compute[71507]:   <on_reboot>restart</on_reboot>
Apr 13 15:10:16 user nova-compute[71507]:   <on_crash>destroy</on_crash>
Apr 13 15:10:16 user nova-compute[71507]:   <devices>
Apr 13 15:10:16 user nova-compute[71507]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 15:10:16 user nova-compute[71507]:     <disk type='file' device='disk'>
Apr 13 15:10:16 user nova-compute[71507]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 15:10:16 user nova-compute[71507]:       <source file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk' index='2'/>
Apr 13 15:10:16 user nova-compute[71507]:       <backingStore type='file' index='3'>
Apr 13 15:10:16 user nova-compute[71507]:         <format type='raw'/>
Apr 13 15:10:16 user nova-compute[71507]:         <source file='/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918'/>
Apr 13 15:10:16 user nova-compute[71507]:         <backingStore/>
Apr 13 15:10:16 user nova-compute[71507]:       </backingStore>
Apr 13 15:10:16 user nova-compute[71507]:       <target dev='vda' bus='virtio'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='virtio-disk0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </disk>
Apr 13 15:10:16 user nova-compute[71507]:     <disk type='file' device='cdrom'>
Apr 13 15:10:16 user nova-compute[71507]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 15:10:16 user nova-compute[71507]:       <source file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.config' index='1'/>
Apr 13 15:10:16 user nova-compute[71507]:       <backingStore/>
Apr 13 15:10:16 user nova-compute[71507]:       <target dev='hda' bus='ide'/>
Apr 13 15:10:16 user nova-compute[71507]:       <readonly/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='ide0-0-0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </disk>
Apr 13 15:10:16 user nova-compute[71507]:     <controller type='usb' index='0' model='none'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='usb'/>
Apr 13 15:10:16 user nova-compute[71507]:     </controller>
Apr 13 15:10:16 user nova-compute[71507]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='pci.0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </controller>
Apr 13 15:10:16 user nova-compute[71507]:     <controller type='ide' index='0'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='ide'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 15:10:16 user nova-compute[71507]:     </controller>
Apr 13 15:10:16 user nova-compute[71507]:     <interface type='ethernet'>
Apr 13 15:10:16 user nova-compute[71507]:       <mac address='fa:16:3e:cd:1d:8a'/>
Apr 13 15:10:16 user nova-compute[71507]:       <target dev='tapce8e302f-1f'/>
Apr 13 15:10:16 user nova-compute[71507]:       <model type='virtio'/>
Apr 13 15:10:16 user nova-compute[71507]:       <mtu size='1442'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='net0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </interface>
Apr 13 15:10:16 user nova-compute[71507]:     <serial type='pty'>
Apr 13 15:10:16 user nova-compute[71507]:       <source path='/dev/pts/9'/>
Apr 13 15:10:16 user nova-compute[71507]:       <log file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log' append='off'/>
Apr 13 15:10:16 user nova-compute[71507]:       <target type='isa-serial' port='0'>
Apr 13 15:10:16 user nova-compute[71507]:         <model name='isa-serial'/>
Apr 13 15:10:16 user nova-compute[71507]:       </target>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='serial0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </serial>
Apr 13 15:10:16 user nova-compute[71507]:     <console type='pty' tty='/dev/pts/9'>
Apr 13 15:10:16 user nova-compute[71507]:       <source path='/dev/pts/9'/>
Apr 13 15:10:16 user nova-compute[71507]:       <log file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log' append='off'/>
Apr 13 15:10:16 user nova-compute[71507]:       <target type='serial' port='0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='serial0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </console>
Apr 13 15:10:16 user nova-compute[71507]:     <input type='mouse' bus='ps2'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='input0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </input>
Apr 13 15:10:16 user nova-compute[71507]:     <input type='keyboard' bus='ps2'>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='input1'/>
Apr 13 15:10:16 user nova-compute[71507]:     </input>
Apr 13 15:10:16 user nova-compute[71507]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 13 15:10:16 user nova-compute[71507]:       <listen type='address' address='0.0.0.0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </graphics>
Apr 13 15:10:16 user nova-compute[71507]:     <audio id='1' type='none'/>
Apr 13 15:10:16 user nova-compute[71507]:     <video>
Apr 13 15:10:16 user nova-compute[71507]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='video0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </video>
Apr 13 15:10:16 user nova-compute[71507]:     <memballoon model='virtio'>
Apr 13 15:10:16 user nova-compute[71507]:       <stats period='10'/>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='balloon0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </memballoon>
Apr 13 15:10:16 user nova-compute[71507]:     <rng model='virtio'>
Apr 13 15:10:16 user nova-compute[71507]:       <backend model='random'>/dev/urandom</backend>
Apr 13 15:10:16 user nova-compute[71507]:       <alias name='rng0'/>
Apr 13 15:10:16 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 15:10:16 user nova-compute[71507]:     </rng>
Apr 13 15:10:16 user nova-compute[71507]:   </devices>
Apr 13 15:10:16 user nova-compute[71507]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 15:10:16 user nova-compute[71507]:     <label>libvirt-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</label>
Apr 13 15:10:16 user nova-compute[71507]:     <imagelabel>libvirt-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</imagelabel>
Apr 13 15:10:16 user nova-compute[71507]:   </seclabel>
Apr 13 15:10:16 user nova-compute[71507]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 15:10:16 user nova-compute[71507]:     <label>+64055:+108</label>
Apr 13 15:10:16 user nova-compute[71507]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 15:10:16 user nova-compute[71507]:   </seclabel>
Apr 13 15:10:16 user nova-compute[71507]: </domain>
Apr 13 15:10:16 user nova-compute[71507]:  {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 15:10:16 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Successfully detached device tapf9729e1e-db from instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc from the live domain config.
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055562483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2055562483',id=10,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A==',key_name='tempest-keypair-1905935028',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be23bf27d7ed4f0abf2fdc60ae1edb71',ramdisk_id='',reservation_id='r-wj2y7pak',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-227294207',owner_user_name='tempest-TaggedAttachmentsTest-227294207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b59f4d6492a4821a621b18766bf58fa',uuid=95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converting VIF {"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG os_vif [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9729e1e-db, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:16 user nova-compute[71507]: INFO os_vif [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db')
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:16 user nova-compute[71507]:   <nova:package version="0.0.0"/>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:name>tempest-device-tagging-server-2055562483</nova:name>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:creationTime>2023-04-13 15:10:16</nova:creationTime>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:flavor name="m1.nano">
Apr 13 15:10:16 user nova-compute[71507]:     <nova:memory>128</nova:memory>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:disk>1</nova:disk>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:swap>0</nova:swap>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:16 user nova-compute[71507]:   </nova:flavor>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:owner>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:user uuid="5b59f4d6492a4821a621b18766bf58fa">tempest-TaggedAttachmentsTest-227294207-project-member</nova:user>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:project uuid="be23bf27d7ed4f0abf2fdc60ae1edb71">tempest-TaggedAttachmentsTest-227294207</nova:project>
Apr 13 15:10:16 user nova-compute[71507]:   </nova:owner>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:16 user nova-compute[71507]:   <nova:ports>
Apr 13 15:10:16 user nova-compute[71507]:     <nova:port uuid="ce8e302f-1f0b-46e0-82ef-9809a6ad81db">
Apr 13 15:10:16 user nova-compute[71507]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:10:16 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:16 user nova-compute[71507]:   </nova:ports>
Apr 13 15:10:16 user nova-compute[71507]: </nova:instance>
Apr 13 15:10:16 user nova-compute[71507]:  {{(pid=71507) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.network.neutron [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updated VIF entry in instance network info cache for port 6e4ead67-98a8-4a15-b31e-6ed9a0d075c5. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.network.neutron [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [{"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-788f42df-a846-4531-b3d4-09662c1b2e36 req-d6b2fa44-f752-4d28-a46d-8e17ebd482b5 service nova] Releasing lock "refresh_cache-e84c85a8-b97d-44ac-b0b3-f898860f5944" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 1016070144 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZexjymJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:17 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f72b2af-14c3-419d-a125-2c66912b399d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:10:17 user nova-compute[71507]: No targets found.
Apr 13 15:10:17 user nova-compute[71507]: iSNS:
Apr 13 15:10:17 user nova-compute[71507]: No targets found.
Apr 13 15:10:17 user nova-compute[71507]: STATIC:
Apr 13 15:10:17 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d
Apr 13 15:10:17 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:17 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:17 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece
Apr 13 15:10:17 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:17 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:17 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91
Apr 13 15:10:17 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:17 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:17 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a
Apr 13 15:10:17 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:17 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:17 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6
Apr 13 15:10:17 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:17 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:17 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:10:17 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:17 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:17 user nova-compute[71507]: FIRMWARE:
Apr 13 15:10:17 user nova-compute[71507]: No targets found.
Apr 13 15:10:17 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:10:17 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:10:17 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602ae76-0253-4442-a707-fc0a38cc8351]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3023462b-d73c-4624-b11d-8bfcfb7abfcc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:17 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:17 user nova-compute[71507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:17 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c258820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d'): ({'sdg'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Removing single pathed devices sdg {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cacdd86-72e8-4e25-ab79-e0083ab85667]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98a121c-e707-46af-8602-075303bb5ae8]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Flushing IO for device /dev/sdg {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b71b82-8028-4cec-9194-bbae48198bde]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updating instance_info_cache with network_info: [{"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5249f5f-6b0a-4ed7-8ff7-cb6a8a8235c1]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] SCSI volumes sdg have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[109d1bb8-0af5-4640-a922-3171b3b2f3c8]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398602.863862, 051e6c4e-3d10-4b43-9099-7abffd84d0d9 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:10:17 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] VM Stopped (Lifecycle Event)
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e3710ca1-4165-42c9-bc45-0a7bfea2869d None None] [instance: 051e6c4e-3d10-4b43-9099-7abffd84d0d9] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-deleted-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:17 user nova-compute[71507]: INFO nova.compute.manager [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Neutron deleted interface f9729e1e-db88-4e50-bc31-f2ad9a568084; detaching it from the instance and deleting it from the info cache
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.network.neutron [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updating instance_info_cache with network_info: [{"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquired lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbf0794-516c-4acc-be8e-807a83142537]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260]
Apr 13 15:10:17 user nova-compute[71507]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:17 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.objects.instance [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Lazy-loading 'system_metadata' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ee617b-2991-4274-baa5-0b9d5f1795b2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] <== disconnect_volume: return (343ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.objects.instance [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Lazy-loading 'flavor' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfvqpXCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '193136fc-e6c3-4e70-b7ab-01ced440c6bd', 'attached_at': '', 'detached_at': '', 'volume_id': '13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'serial'} {{(pid=71507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] swap_volume: removing Cinder connection for volume 3c648678-ad4b-4ce5-b267-ebf3abef2c5d {{(pid=71507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055562483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2055562483',id=10,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A==',key_name='tempest-keypair-1905935028',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be23bf27d7ed4f0abf2fdc60ae1edb71',ramdisk_id='',reservation_id='r-wj2y7pak',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-227294207',owner_user_name='tempest-TaggedAttachmentsTest-227294207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b59f4d6492a4821a621b18766bf58fa',uuid=95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.network.os_vif_util [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Converting VIF {"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.network.os_vif_util [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface> {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 13 15:10:18 user nova-compute[71507]:   <name>instance-0000000a</name>
Apr 13 15:10:18 user nova-compute[71507]:   <uuid>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</uuid>
Apr 13 15:10:18 user nova-compute[71507]:   <metadata>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:18 user nova-compute[71507]:   <nova:package version="0.0.0"/>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:name>tempest-device-tagging-server-2055562483</nova:name>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:creationTime>2023-04-13 15:10:16</nova:creationTime>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:flavor name="m1.nano">
Apr 13 15:10:18 user nova-compute[71507]:     <nova:memory>128</nova:memory>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:disk>1</nova:disk>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:swap>0</nova:swap>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:18 user nova-compute[71507]:   </nova:flavor>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:owner>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:user uuid="5b59f4d6492a4821a621b18766bf58fa">tempest-TaggedAttachmentsTest-227294207-project-member</nova:user>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:project uuid="be23bf27d7ed4f0abf2fdc60ae1edb71">tempest-TaggedAttachmentsTest-227294207</nova:project>
Apr 13 15:10:18 user nova-compute[71507]:   </nova:owner>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:ports>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:port uuid="ce8e302f-1f0b-46e0-82ef-9809a6ad81db">
Apr 13 15:10:18 user nova-compute[71507]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:10:18 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:18 user nova-compute[71507]:   </nova:ports>
Apr 13 15:10:18 user nova-compute[71507]: </nova:instance>
Apr 13 15:10:18 user nova-compute[71507]:   </metadata>
Apr 13 15:10:18 user nova-compute[71507]:   <memory unit='KiB'>131072</memory>
Apr 13 15:10:18 user nova-compute[71507]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 15:10:18 user nova-compute[71507]:   <vcpu placement='static'>1</vcpu>
Apr 13 15:10:18 user nova-compute[71507]:   <resource>
Apr 13 15:10:18 user nova-compute[71507]:     <partition>/machine</partition>
Apr 13 15:10:18 user nova-compute[71507]:   </resource>
Apr 13 15:10:18 user nova-compute[71507]:   <sysinfo type='smbios'>
Apr 13 15:10:18 user nova-compute[71507]:     <system>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='version'>0.0.0</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='serial'>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='uuid'>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='family'>Virtual Machine</entry>
Apr 13 15:10:18 user nova-compute[71507]:     </system>
Apr 13 15:10:18 user nova-compute[71507]:   </sysinfo>
Apr 13 15:10:18 user nova-compute[71507]:   <os>
Apr 13 15:10:18 user nova-compute[71507]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 15:10:18 user nova-compute[71507]:     <boot dev='hd'/>
Apr 13 15:10:18 user nova-compute[71507]:     <smbios mode='sysinfo'/>
Apr 13 15:10:18 user nova-compute[71507]:   </os>
Apr 13 15:10:18 user nova-compute[71507]:   <features>
Apr 13 15:10:18 user nova-compute[71507]:     <acpi/>
Apr 13 15:10:18 user nova-compute[71507]:     <apic/>
Apr 13 15:10:18 user nova-compute[71507]:     <vmcoreinfo state='on'/>
Apr 13 15:10:18 user nova-compute[71507]:   </features>
Apr 13 15:10:18 user nova-compute[71507]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 15:10:18 user nova-compute[71507]:     <model fallback='forbid'>Nehalem</model>
Apr 13 15:10:18 user nova-compute[71507]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 15:10:18 user nova-compute[71507]:     <feature policy='require' name='vme'/>
Apr 13 15:10:18 user nova-compute[71507]:     <feature policy='require' name='x2apic'/>
Apr 13 15:10:18 user nova-compute[71507]:     <feature policy='require' name='hypervisor'/>
Apr 13 15:10:18 user nova-compute[71507]:   </cpu>
Apr 13 15:10:18 user nova-compute[71507]:   <clock offset='utc'>
Apr 13 15:10:18 user nova-compute[71507]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 15:10:18 user nova-compute[71507]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 15:10:18 user nova-compute[71507]:     <timer name='hpet' present='no'/>
Apr 13 15:10:18 user nova-compute[71507]:   </clock>
Apr 13 15:10:18 user nova-compute[71507]:   <on_poweroff>destroy</on_poweroff>
Apr 13 15:10:18 user nova-compute[71507]:   <on_reboot>restart</on_reboot>
Apr 13 15:10:18 user nova-compute[71507]:   <on_crash>destroy</on_crash>
Apr 13 15:10:18 user nova-compute[71507]:   <devices>
Apr 13 15:10:18 user nova-compute[71507]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 15:10:18 user nova-compute[71507]:     <disk type='file' device='disk'>
Apr 13 15:10:18 user nova-compute[71507]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 15:10:18 user nova-compute[71507]:       <source file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk' index='2'/>
Apr 13 15:10:18 user nova-compute[71507]:       <backingStore type='file' index='3'>
Apr 13 15:10:18 user nova-compute[71507]:         <format type='raw'/>
Apr 13 15:10:18 user nova-compute[71507]:         <source file='/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918'/>
Apr 13 15:10:18 user nova-compute[71507]:         <backingStore/>
Apr 13 15:10:18 user nova-compute[71507]:       </backingStore>
Apr 13 15:10:18 user nova-compute[71507]:       <target dev='vda' bus='virtio'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='virtio-disk0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </disk>
Apr 13 15:10:18 user nova-compute[71507]:     <disk type='file' device='cdrom'>
Apr 13 15:10:18 user nova-compute[71507]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 15:10:18 user nova-compute[71507]:       <source file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.config' index='1'/>
Apr 13 15:10:18 user nova-compute[71507]:       <backingStore/>
Apr 13 15:10:18 user nova-compute[71507]:       <target dev='hda' bus='ide'/>
Apr 13 15:10:18 user nova-compute[71507]:       <readonly/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='ide0-0-0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </disk>
Apr 13 15:10:18 user nova-compute[71507]:     <controller type='usb' index='0' model='none'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='usb'/>
Apr 13 15:10:18 user nova-compute[71507]:     </controller>
Apr 13 15:10:18 user nova-compute[71507]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='pci.0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </controller>
Apr 13 15:10:18 user nova-compute[71507]:     <controller type='ide' index='0'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='ide'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 15:10:18 user nova-compute[71507]:     </controller>
Apr 13 15:10:18 user nova-compute[71507]:     <interface type='ethernet'>
Apr 13 15:10:18 user nova-compute[71507]:       <mac address='fa:16:3e:cd:1d:8a'/>
Apr 13 15:10:18 user nova-compute[71507]:       <target dev='tapce8e302f-1f'/>
Apr 13 15:10:18 user nova-compute[71507]:       <model type='virtio'/>
Apr 13 15:10:18 user nova-compute[71507]:       <mtu size='1442'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='net0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </interface>
Apr 13 15:10:18 user nova-compute[71507]:     <serial type='pty'>
Apr 13 15:10:18 user nova-compute[71507]:       <source path='/dev/pts/9'/>
Apr 13 15:10:18 user nova-compute[71507]:       <log file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log' append='off'/>
Apr 13 15:10:18 user nova-compute[71507]:       <target type='isa-serial' port='0'>
Apr 13 15:10:18 user nova-compute[71507]:         <model name='isa-serial'/>
Apr 13 15:10:18 user nova-compute[71507]:       </target>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='serial0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </serial>
Apr 13 15:10:18 user nova-compute[71507]:     <console type='pty' tty='/dev/pts/9'>
Apr 13 15:10:18 user nova-compute[71507]:       <source path='/dev/pts/9'/>
Apr 13 15:10:18 user nova-compute[71507]:       <log file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log' append='off'/>
Apr 13 15:10:18 user nova-compute[71507]:       <target type='serial' port='0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='serial0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </console>
Apr 13 15:10:18 user nova-compute[71507]:     <input type='mouse' bus='ps2'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='input0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </input>
Apr 13 15:10:18 user nova-compute[71507]:     <input type='keyboard' bus='ps2'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='input1'/>
Apr 13 15:10:18 user nova-compute[71507]:     </input>
Apr 13 15:10:18 user nova-compute[71507]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 13 15:10:18 user nova-compute[71507]:       <listen type='address' address='0.0.0.0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </graphics>
Apr 13 15:10:18 user nova-compute[71507]:     <audio id='1' type='none'/>
Apr 13 15:10:18 user nova-compute[71507]:     <video>
Apr 13 15:10:18 user nova-compute[71507]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='video0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </video>
Apr 13 15:10:18 user nova-compute[71507]:     <memballoon model='virtio'>
Apr 13 15:10:18 user nova-compute[71507]:       <stats period='10'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='balloon0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </memballoon>
Apr 13 15:10:18 user nova-compute[71507]:     <rng model='virtio'>
Apr 13 15:10:18 user nova-compute[71507]:       <backend model='random'>/dev/urandom</backend>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='rng0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </rng>
Apr 13 15:10:18 user nova-compute[71507]:   </devices>
Apr 13 15:10:18 user nova-compute[71507]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 15:10:18 user nova-compute[71507]:     <label>libvirt-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</label>
Apr 13 15:10:18 user nova-compute[71507]:     <imagelabel>libvirt-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</imagelabel>
Apr 13 15:10:18 user nova-compute[71507]:   </seclabel>
Apr 13 15:10:18 user nova-compute[71507]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 15:10:18 user nova-compute[71507]:     <label>+64055:+108</label>
Apr 13 15:10:18 user nova-compute[71507]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 15:10:18 user nova-compute[71507]:   </seclabel>
Apr 13 15:10:18 user nova-compute[71507]: </domain>
Apr 13 15:10:18 user nova-compute[71507]:  {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface> {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e6:75:b5"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9729e1e-db"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 13 15:10:18 user nova-compute[71507]:   <name>instance-0000000a</name>
Apr 13 15:10:18 user nova-compute[71507]:   <uuid>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</uuid>
Apr 13 15:10:18 user nova-compute[71507]:   <metadata>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:18 user nova-compute[71507]:   <nova:package version="0.0.0"/>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:name>tempest-device-tagging-server-2055562483</nova:name>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:creationTime>2023-04-13 15:10:16</nova:creationTime>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:flavor name="m1.nano">
Apr 13 15:10:18 user nova-compute[71507]:     <nova:memory>128</nova:memory>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:disk>1</nova:disk>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:swap>0</nova:swap>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:18 user nova-compute[71507]:   </nova:flavor>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:owner>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:user uuid="5b59f4d6492a4821a621b18766bf58fa">tempest-TaggedAttachmentsTest-227294207-project-member</nova:user>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:project uuid="be23bf27d7ed4f0abf2fdc60ae1edb71">tempest-TaggedAttachmentsTest-227294207</nova:project>
Apr 13 15:10:18 user nova-compute[71507]:   </nova:owner>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:ports>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:port uuid="ce8e302f-1f0b-46e0-82ef-9809a6ad81db">
Apr 13 15:10:18 user nova-compute[71507]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:10:18 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:18 user nova-compute[71507]:   </nova:ports>
Apr 13 15:10:18 user nova-compute[71507]: </nova:instance>
Apr 13 15:10:18 user nova-compute[71507]:   </metadata>
Apr 13 15:10:18 user nova-compute[71507]:   <memory unit='KiB'>131072</memory>
Apr 13 15:10:18 user nova-compute[71507]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 15:10:18 user nova-compute[71507]:   <vcpu placement='static'>1</vcpu>
Apr 13 15:10:18 user nova-compute[71507]:   <resource>
Apr 13 15:10:18 user nova-compute[71507]:     <partition>/machine</partition>
Apr 13 15:10:18 user nova-compute[71507]:   </resource>
Apr 13 15:10:18 user nova-compute[71507]:   <sysinfo type='smbios'>
Apr 13 15:10:18 user nova-compute[71507]:     <system>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='version'>0.0.0</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='serial'>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='uuid'>95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</entry>
Apr 13 15:10:18 user nova-compute[71507]:       <entry name='family'>Virtual Machine</entry>
Apr 13 15:10:18 user nova-compute[71507]:     </system>
Apr 13 15:10:18 user nova-compute[71507]:   </sysinfo>
Apr 13 15:10:18 user nova-compute[71507]:   <os>
Apr 13 15:10:18 user nova-compute[71507]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 15:10:18 user nova-compute[71507]:     <boot dev='hd'/>
Apr 13 15:10:18 user nova-compute[71507]:     <smbios mode='sysinfo'/>
Apr 13 15:10:18 user nova-compute[71507]:   </os>
Apr 13 15:10:18 user nova-compute[71507]:   <features>
Apr 13 15:10:18 user nova-compute[71507]:     <acpi/>
Apr 13 15:10:18 user nova-compute[71507]:     <apic/>
Apr 13 15:10:18 user nova-compute[71507]:     <vmcoreinfo state='on'/>
Apr 13 15:10:18 user nova-compute[71507]:   </features>
Apr 13 15:10:18 user nova-compute[71507]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 15:10:18 user nova-compute[71507]:     <model fallback='forbid'>Nehalem</model>
Apr 13 15:10:18 user nova-compute[71507]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 15:10:18 user nova-compute[71507]:     <feature policy='require' name='vme'/>
Apr 13 15:10:18 user nova-compute[71507]:     <feature policy='require' name='x2apic'/>
Apr 13 15:10:18 user nova-compute[71507]:     <feature policy='require' name='hypervisor'/>
Apr 13 15:10:18 user nova-compute[71507]:   </cpu>
Apr 13 15:10:18 user nova-compute[71507]:   <clock offset='utc'>
Apr 13 15:10:18 user nova-compute[71507]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 15:10:18 user nova-compute[71507]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 15:10:18 user nova-compute[71507]:     <timer name='hpet' present='no'/>
Apr 13 15:10:18 user nova-compute[71507]:   </clock>
Apr 13 15:10:18 user nova-compute[71507]:   <on_poweroff>destroy</on_poweroff>
Apr 13 15:10:18 user nova-compute[71507]:   <on_reboot>restart</on_reboot>
Apr 13 15:10:18 user nova-compute[71507]:   <on_crash>destroy</on_crash>
Apr 13 15:10:18 user nova-compute[71507]:   <devices>
Apr 13 15:10:18 user nova-compute[71507]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 15:10:18 user nova-compute[71507]:     <disk type='file' device='disk'>
Apr 13 15:10:18 user nova-compute[71507]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 15:10:18 user nova-compute[71507]:       <source file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk' index='2'/>
Apr 13 15:10:18 user nova-compute[71507]:       <backingStore type='file' index='3'>
Apr 13 15:10:18 user nova-compute[71507]:         <format type='raw'/>
Apr 13 15:10:18 user nova-compute[71507]:         <source file='/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918'/>
Apr 13 15:10:18 user nova-compute[71507]:         <backingStore/>
Apr 13 15:10:18 user nova-compute[71507]:       </backingStore>
Apr 13 15:10:18 user nova-compute[71507]:       <target dev='vda' bus='virtio'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='virtio-disk0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </disk>
Apr 13 15:10:18 user nova-compute[71507]:     <disk type='file' device='cdrom'>
Apr 13 15:10:18 user nova-compute[71507]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 15:10:18 user nova-compute[71507]:       <source file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk.config' index='1'/>
Apr 13 15:10:18 user nova-compute[71507]:       <backingStore/>
Apr 13 15:10:18 user nova-compute[71507]:       <target dev='hda' bus='ide'/>
Apr 13 15:10:18 user nova-compute[71507]:       <readonly/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='ide0-0-0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </disk>
Apr 13 15:10:18 user nova-compute[71507]:     <controller type='usb' index='0' model='none'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='usb'/>
Apr 13 15:10:18 user nova-compute[71507]:     </controller>
Apr 13 15:10:18 user nova-compute[71507]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='pci.0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </controller>
Apr 13 15:10:18 user nova-compute[71507]:     <controller type='ide' index='0'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='ide'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 15:10:18 user nova-compute[71507]:     </controller>
Apr 13 15:10:18 user nova-compute[71507]:     <interface type='ethernet'>
Apr 13 15:10:18 user nova-compute[71507]:       <mac address='fa:16:3e:cd:1d:8a'/>
Apr 13 15:10:18 user nova-compute[71507]:       <target dev='tapce8e302f-1f'/>
Apr 13 15:10:18 user nova-compute[71507]:       <model type='virtio'/>
Apr 13 15:10:18 user nova-compute[71507]:       <mtu size='1442'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='net0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </interface>
Apr 13 15:10:18 user nova-compute[71507]:     <serial type='pty'>
Apr 13 15:10:18 user nova-compute[71507]:       <source path='/dev/pts/9'/>
Apr 13 15:10:18 user nova-compute[71507]:       <log file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log' append='off'/>
Apr 13 15:10:18 user nova-compute[71507]:       <target type='isa-serial' port='0'>
Apr 13 15:10:18 user nova-compute[71507]:         <model name='isa-serial'/>
Apr 13 15:10:18 user nova-compute[71507]:       </target>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='serial0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </serial>
Apr 13 15:10:18 user nova-compute[71507]:     <console type='pty' tty='/dev/pts/9'>
Apr 13 15:10:18 user nova-compute[71507]:       <source path='/dev/pts/9'/>
Apr 13 15:10:18 user nova-compute[71507]:       <log file='/opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/console.log' append='off'/>
Apr 13 15:10:18 user nova-compute[71507]:       <target type='serial' port='0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='serial0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </console>
Apr 13 15:10:18 user nova-compute[71507]:     <input type='mouse' bus='ps2'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='input0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </input>
Apr 13 15:10:18 user nova-compute[71507]:     <input type='keyboard' bus='ps2'>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='input1'/>
Apr 13 15:10:18 user nova-compute[71507]:     </input>
Apr 13 15:10:18 user nova-compute[71507]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 13 15:10:18 user nova-compute[71507]:       <listen type='address' address='0.0.0.0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </graphics>
Apr 13 15:10:18 user nova-compute[71507]:     <audio id='1' type='none'/>
Apr 13 15:10:18 user nova-compute[71507]:     <video>
Apr 13 15:10:18 user nova-compute[71507]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='video0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </video>
Apr 13 15:10:18 user nova-compute[71507]:     <memballoon model='virtio'>
Apr 13 15:10:18 user nova-compute[71507]:       <stats period='10'/>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='balloon0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </memballoon>
Apr 13 15:10:18 user nova-compute[71507]:     <rng model='virtio'>
Apr 13 15:10:18 user nova-compute[71507]:       <backend model='random'>/dev/urandom</backend>
Apr 13 15:10:18 user nova-compute[71507]:       <alias name='rng0'/>
Apr 13 15:10:18 user nova-compute[71507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 15:10:18 user nova-compute[71507]:     </rng>
Apr 13 15:10:18 user nova-compute[71507]:   </devices>
Apr 13 15:10:18 user nova-compute[71507]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 15:10:18 user nova-compute[71507]:     <label>libvirt-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</label>
Apr 13 15:10:18 user nova-compute[71507]:     <imagelabel>libvirt-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc</imagelabel>
Apr 13 15:10:18 user nova-compute[71507]:   </seclabel>
Apr 13 15:10:18 user nova-compute[71507]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 15:10:18 user nova-compute[71507]:     <label>+64055:+108</label>
Apr 13 15:10:18 user nova-compute[71507]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 15:10:18 user nova-compute[71507]:   </seclabel>
Apr 13 15:10:18 user nova-compute[71507]: </domain>
Apr 13 15:10:18 user nova-compute[71507]:  {{(pid=71507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 15:10:18 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Detaching interface fa:16:3e:e6:75:b5 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapf9729e1e-db' not found.
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055562483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2055562483',id=10,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A==',key_name='tempest-keypair-1905935028',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be23bf27d7ed4f0abf2fdc60ae1edb71',ramdisk_id='',reservation_id='r-wj2y7pak',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-227294207',owner_user_name='tempest-TaggedAttachmentsTest-227294207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b59f4d6492a4821a621b18766bf58fa',uuid=95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.network.os_vif_util [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Converting VIF {"id": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "address": "fa:16:3e:e6:75:b5", "network": {"id": "5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-794210362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9729e1e-db", "ovs_interfaceid": "f9729e1e-db88-4e50-bc31-f2ad9a568084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.network.os_vif_util [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG os_vif [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9729e1e-db, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-unplugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] No waiting events found dispatching network-vif-unplugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:18 user nova-compute[71507]: WARNING nova.compute.manager [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received unexpected event network-vif-unplugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance with vm_state active and task_state None.
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-plugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] No waiting events found dispatching network-vif-plugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:18 user nova-compute[71507]: WARNING nova.compute.manager [req-73c1ea3c-64dd-4294-8539-8deb002868f6 req-14510a5f-77ae-48ce-84c6-dc50f6b4bc22 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received unexpected event network-vif-plugged-f9729e1e-db88-4e50-bc31-f2ad9a568084 for instance with vm_state active and task_state None.
Apr 13 15:10:18 user nova-compute[71507]: INFO os_vif [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=f9729e1e-db88-4e50-bc31-f2ad9a568084,network=Network(5fb5d3f3-ecb3-4e29-8a72-b1200d4fa867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9729e1e-db')
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [req-414c0f68-2edf-47cf-b502-3a5a6f6ebf31 req-d8ff0c7f-596e-4b26-8ad9-880093b85a22 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:18 user nova-compute[71507]:   <nova:package version="0.0.0"/>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:name>tempest-device-tagging-server-2055562483</nova:name>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:creationTime>2023-04-13 15:10:18</nova:creationTime>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:flavor name="m1.nano">
Apr 13 15:10:18 user nova-compute[71507]:     <nova:memory>128</nova:memory>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:disk>1</nova:disk>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:swap>0</nova:swap>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:18 user nova-compute[71507]:   </nova:flavor>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:owner>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:user uuid="5b59f4d6492a4821a621b18766bf58fa">tempest-TaggedAttachmentsTest-227294207-project-member</nova:user>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:project uuid="be23bf27d7ed4f0abf2fdc60ae1edb71">tempest-TaggedAttachmentsTest-227294207</nova:project>
Apr 13 15:10:18 user nova-compute[71507]:   </nova:owner>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:18 user nova-compute[71507]:   <nova:ports>
Apr 13 15:10:18 user nova-compute[71507]:     <nova:port uuid="ce8e302f-1f0b-46e0-82ef-9809a6ad81db">
Apr 13 15:10:18 user nova-compute[71507]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:10:18 user nova-compute[71507]:     </nova:port>
Apr 13 15:10:18 user nova-compute[71507]:   </nova:ports>
Apr 13 15:10:18 user nova-compute[71507]: </nova:instance>
Apr 13 15:10:18 user nova-compute[71507]:  {{(pid=71507) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:18 user nova-compute[71507]: INFO nova.compute.manager [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Terminating instance
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-unplugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-ac1fbe99-c84e-4023-b60f-308bfaca5011 req-ce4250bc-d76d-43fe-9363-dbc41e371647 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:19 user nova-compute[71507]: INFO nova.network.neutron [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Port f9729e1e-db88-4e50-bc31-f2ad9a568084 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 13 15:10:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updating instance_info_cache with network_info: [{"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Releasing lock "refresh_cache-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e35228e6-c525-4f75-b69e-6a5b71f9ae03 tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "interface-95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-f9729e1e-db88-4e50-bc31-f2ad9a568084" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.936s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] swap_volume: Updating volume 3c648678-ad4b-4ce5-b267-ebf3abef2c5d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "AfvqpXCN", "auth_password": "Oglt2yDF4zESkv", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "13c8ec19-b219-44c8-9c72-1a5a06e96d91"}, "status": "reserved", "instance": "193136fc-e6c3-4e70-b7ab-01ced440c6bd", "attached_at": "", "detached_at": "", "volume_id": "13c8ec19-b219-44c8-9c72-1a5a06e96d91", "serial": "13c8ec19-b219-44c8-9c72-1a5a06e96d91"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'no_device': None, 'attachment_id': '0287afcb-8c0c-40ff-8395-966ea696f055'} {{(pid=71507) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-71e0e6ea-f979-4ae6-b69f-746de4c16b11 tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.377s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:10:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:10:19 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Instance destroyed successfully.
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lazy-loading 'resources' on Instance uuid e84c85a8-b97d-44ac-b0b3-f898860f5944 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:6c:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4ead67-98a8-4a15-b31e-6ed9a0d075c5,network=Network(7a95cb70-f248-48c3-bcaf-29e420112188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4ead67-98') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:6c:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4ead67-98a8-4a15-b31e-6ed9a0d075c5,network=Network(7a95cb70-f248-48c3-bcaf-29e420112188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4ead67-98') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e4ead67-98, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: INFO os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:6c:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4ead67-98a8-4a15-b31e-6ed9a0d075c5,network=Network(7a95cb70-f248-48c3-bcaf-29e420112188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4ead67-98')
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:39:4f,bridge_name='br-int',has_traffic_filtering=True,id=f81f8894-95c8-443a-92e6-0bbc31c8e87c,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81f8894-95') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:39:4f,bridge_name='br-int',has_traffic_filtering=True,id=f81f8894-95c8-443a-92e6-0bbc31c8e87c,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81f8894-95') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf81f8894-95, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-unplugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:20 user nova-compute[71507]: WARNING nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 for instance with vm_state active and task_state deleting.
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-unplugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:20 user nova-compute[71507]: WARNING nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-f81f8894-95c8-443a-92e6-0bbc31c8e87c for instance with vm_state active and task_state deleting.
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-unplugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:20 user nova-compute[71507]: WARNING nova.compute.manager [req-e554a5a0-ac7e-4dd2-9fa2-0d8b9156fe23 req-cf02bc87-7416-466e-bbbc-fd95c7a65d01 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-d2e29dc8-81b4-4712-9be4-e97c7f116aed for instance with vm_state active and task_state deleting.
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:10:20 user nova-compute[71507]: INFO os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:39:4f,bridge_name='br-int',has_traffic_filtering=True,id=f81f8894-95c8-443a-92e6-0bbc31c8e87c,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81f8894-95')
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2e29dc8-81b4-4712-9be4-e97c7f116aed,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2e29dc8-81') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2e29dc8-81b4-4712-9be4-e97c7f116aed,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2e29dc8-81') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2e29dc8-81, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: INFO os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7e,bridge_name='br-int',has_traffic_filtering=True,id=d2e29dc8-81b4-4712-9be4-e97c7f116aed,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2e29dc8-81')
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "address": "fa:16:3e:20:b6:e3", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bbdcb7f-44", "ovs_interfaceid": "0bbdcb7f-44fc-4144-9dcc-b82be1a036fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=0bbdcb7f-44fc-4144-9dcc-b82be1a036fd,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbdcb7f-44') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=0bbdcb7f-44fc-4144-9dcc-b82be1a036fd,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbdcb7f-44') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bbdcb7f-44, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: INFO os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=0bbdcb7f-44fc-4144-9dcc-b82be1a036fd,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bbdcb7f-44')
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5f:b6,bridge_name='br-int',has_traffic_filtering=True,id=a1f1b21e-12c3-4310-9ef0-791f4d09fc5f,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f1b21e-12') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5f:b6,bridge_name='br-int',has_traffic_filtering=True,id=a1f1b21e-12c3-4310-9ef0-791f4d09fc5f,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f1b21e-12') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1f1b21e-12, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: INFO os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5f:b6,bridge_name='br-int',has_traffic_filtering=True,id=a1f1b21e-12c3-4310-9ef0-791f4d09fc5f,network=Network(8714ab90-e3fa-42fe-9a01-0fafb55cbb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f1b21e-12')
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=989ec3b8-1a00-47b5-9a07-71f33cfb6c69,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989ec3b8-1a') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=989ec3b8-1a00-47b5-9a07-71f33cfb6c69,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989ec3b8-1a') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap989ec3b8-1a, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: INFO os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=989ec3b8-1a00-47b5-9a07-71f33cfb6c69,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989ec3b8-1a')
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1904364306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1904364306',id=11,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLinoRPLz0nbFXWDPr7k58hJ264Tbknste6rDK+Ch+8Z+XymlDJ+HtRhI3tMRzznzZJX6mhZoLHiFuT/TTqxUYfiPYH5vZOnI3OdTD46KaIF6vCdJ8MDnTAISIj8f7x3w==',key_name='tempest-keypair-522600936',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d530eb6a4bf04f468299323520f56d1d',ramdisk_id='',reservation_id='r-6jsjz6zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1120084057',owner_user_name='tempest-TaggedBootDevicesTest-1120084057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40c18c8a515b457088a9901fbc86629f',uuid=e84c85a8-b97d-44ac-b0b3-f898860f5944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converting VIF {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:15:e7,bridge_name='br-int',has_traffic_filtering=True,id=c97ac499-c8fa-412e-9452-c6f80e69c879,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc97ac499-c8') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:15:e7,bridge_name='br-int',has_traffic_filtering=True,id=c97ac499-c8fa-412e-9452-c6f80e69c879,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc97ac499-c8') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc97ac499-c8, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:20 user nova-compute[71507]: INFO os_vif [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:15:e7,bridge_name='br-int',has_traffic_filtering=True,id=c97ac499-c8fa-412e-9452-c6f80e69c879,network=Network(d3469945-df22-46a3-b22f-8f2b269fe93a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc97ac499-c8')
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLgEJWYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:20 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f756d778-e402-4fd2-8216-3da359662d7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:10:20 user nova-compute[71507]: No targets found.
Apr 13 15:10:20 user nova-compute[71507]: iSNS:
Apr 13 15:10:20 user nova-compute[71507]: No targets found.
Apr 13 15:10:20 user nova-compute[71507]: STATIC:
Apr 13 15:10:20 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece
Apr 13 15:10:20 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:20 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:20 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91
Apr 13 15:10:20 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:20 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:20 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a
Apr 13 15:10:20 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:20 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:20 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6
Apr 13 15:10:20 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:20 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:20 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:10:20 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:20 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:20 user nova-compute[71507]: FIRMWARE:
Apr 13 15:10:20 user nova-compute[71507]: No targets found.
Apr 13 15:10:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:10:20 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:10:20 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63566a8-936c-4785-bddc-01bd5f59322a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8068cec-27fa-4931-912d-f31095bde653]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:20 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:20 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:20 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:20 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:20 user nova-compute[71507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 (non-flash)
Apr 13 15:10:20 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:20 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:20 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab289a3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c7b19-6bb1-4039-b8b8-5941c6eebc5b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab312e2-99ec-4958-a71f-4750f9ef0cba]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f115710b-5499-4184-94ce-e4fcf835f4a2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.105s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b804bdf2-5f8b-4a7d-ab7a-bbb58a545494]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d86eea8-0007-4745-ae99-a22790282f27]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:21 user nova-compute[71507]: WARNING nova.compute.manager [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd for instance with vm_state active and task_state deleting.
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-unplugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:21 user nova-compute[71507]: WARNING nova.compute.manager [req-af27ec75-4c47-47c3-a465-6361b5dc47ee req-f1505446-f1c6-46fa-b6ee-b76a99b26491 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f for instance with vm_state active and task_state deleting.
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.utils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619009e-3393-4073-b231-c20761eaf62a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeffbd2c-e103-48f5-8d7a-7da186ddfb11]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6, portal: 172.16.0.220,3260]
Apr 13 15:10:21 user nova-compute[71507]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[21303066-e272-46d6-a213-df2c64722f17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[133aed11-ca38-41ed-8994-ec548e8962cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a098f171-2580-4930-a4a3-79cac86e30d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe16f6c-cb3a-4f6c-acca-4d301df8f5d9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.896s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] <== disconnect_volume: return (898ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[159fff95-6f43-45a1-917a-37cf9b1aea39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFdBQSWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:21 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:21 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:10:21 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7686MB free_disk=26.364486694335938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:10:21 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e4f654-326a-4581-bad3-38fbc54c039d]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.utils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] <== get_connector_properties: return (561ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1a487c-bcf2-4860-8df6-bc0cd81d6a43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:10:21 user nova-compute[71507]: No targets found.
Apr 13 15:10:21 user nova-compute[71507]: iSNS:
Apr 13 15:10:21 user nova-compute[71507]: No targets found.
Apr 13 15:10:21 user nova-compute[71507]: STATIC:
Apr 13 15:10:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece
Apr 13 15:10:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91
Apr 13 15:10:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a
Apr 13 15:10:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:10:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:21 user nova-compute[71507]: FIRMWARE:
Apr 13 15:10:21 user nova-compute[71507]: No targets found.
Apr 13 15:10:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:10:21 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:10:21 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e876f9-2101-4b22-ac71-16093b01c7b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c8b6de-6e24-45fc-9241-16aa07a87de1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:21 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:21 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:21 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:21 user nova-compute[71507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece (non-flash)
Apr 13 15:10:21 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:21 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c48b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162b377-9fe0-40c3-bde7-b2c2139da1d0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafb50b0-f1a3-4605-be0b-9e69476db7c3]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: INFO nova.compute.manager [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Swapping volume 13c8ec19-b219-44c8-9c72-1a5a06e96d91 for 3c648678-ad4b-4ce5-b267-ebf3abef2c5d
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 654608ee-5897-429a-b19c-6845d4e84818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 179b6945-589d-402c-a89e-6b8d68725211 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[403fccfa-8ba1-40f9-8af5-49c80229a0cb]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b5a4be-6a2e-4f93-a254-82f5c4994aed]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c314bb7-f277-41dd-83ab-906612420b79]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ef0bf-cab1-468a-887c-fed82fc2ac52]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece, portal: 172.16.0.220,3260]
Apr 13 15:10:21 user nova-compute[71507]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3296f7da-aff3-46a3-8567-6d8fd71c9ece -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bc4ae2-c79d-4287-86b2-22c1f0ecbb84]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] <== disconnect_volume: return (341ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNJrdnRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:21 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb149e81-94f8-40bc-b2f1-683742350168]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:10:21 user nova-compute[71507]: No targets found.
Apr 13 15:10:21 user nova-compute[71507]: iSNS:
Apr 13 15:10:21 user nova-compute[71507]: No targets found.
Apr 13 15:10:21 user nova-compute[71507]: STATIC:
Apr 13 15:10:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91
Apr 13 15:10:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a
Apr 13 15:10:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:10:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:21 user nova-compute[71507]: FIRMWARE:
Apr 13 15:10:21 user nova-compute[71507]: No targets found.
Apr 13 15:10:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:10:21 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:10:21 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[892f95d9-0518-4c46-8e32-221e3019f188]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f487235-2ffa-4ced-aebe-d81e035fd27d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:22 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:22 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:22 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:22 user nova-compute[71507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a (non-flash)
Apr 13 15:10:22 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:22 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c643880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a'): ({'sdd'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Removing single pathed devices sdd {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f6bac-9334-4245-a6f9-2cd952974ba1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d1a5b-9c46-46d6-9838-6ab86f465ecb]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Flushing IO for device /dev/sdd {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[317aaf5e-197a-43ab-82fc-b6d7fa1aa9ea]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b750cf-3dd8-4779-8190-db26f8026b29]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36fc481-f534-4a5d-bd22-0d48b412b063]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba66a9dc-4824-4cd9-8944-3ca7f299bc4d]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a, portal: 172.16.0.220,3260]
Apr 13 15:10:22 user nova-compute[71507]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:22 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62eeb8c-6d75-4da8-8262-5afab3861b5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b430d03-a2b5-4d81-81d1-28f1781d56b5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] <== disconnect_volume: return (338ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:10:22 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Deleting instance files /opt/stack/data/nova/instances/e84c85a8-b97d-44ac-b0b3-f898860f5944_del
Apr 13 15:10:22 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Deletion of /opt/stack/data/nova/instances/e84c85a8-b97d-44ac-b0b3-f898860f5944_del complete
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-unplugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:22 user nova-compute[71507]: WARNING nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 for instance with vm_state active and task_state deleting.
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-unplugged-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-unplugged-c97ac499-c8fa-412e-9452-c6f80e69c879 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-plugged-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Acquiring lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] No waiting events found dispatching network-vif-plugged-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:22 user nova-compute[71507]: WARNING nova.compute.manager [req-f690a4e0-f9a2-4af3-9480-44be880923aa req-eb8b6eb0-adaa-40b4-8573-4bbe4671d462 service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received unexpected event network-vif-plugged-c97ac499-c8fa-412e-9452-c6f80e69c879 for instance with vm_state active and task_state deleting.
Apr 13 15:10:22 user nova-compute[71507]: INFO nova.compute.manager [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Took 4.03 seconds to destroy the instance on the hypervisor.
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:10:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:10:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-deleted-0bbdcb7f-44fc-4144-9dcc-b82be1a036fd {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:23 user nova-compute[71507]: INFO nova.compute.manager [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Neutron deleted interface 0bbdcb7f-44fc-4144-9dcc-b82be1a036fd; detaching it from the instance and deleting it from the info cache
Apr 13 15:10:23 user nova-compute[71507]: DEBUG nova.network.neutron [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [{"id": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "address": "fa:16:3e:c6:6c:09", "network": {"id": "7a95cb70-f248-48c3-bcaf-29e420112188", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1483742955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4ead67-98", "ovs_interfaceid": "6e4ead67-98a8-4a15-b31e-6ed9a0d075c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "address": "fa:16:3e:6f:39:4f", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81f8894-95", "ovs_interfaceid": "f81f8894-95c8-443a-92e6-0bbc31c8e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "address": "fa:16:3e:82:84:7e", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e29dc8-81", "ovs_interfaceid": "d2e29dc8-81b4-4712-9be4-e97c7f116aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "address": "fa:16:3e:61:5f:b6", "network": {"id": "8714ab90-e3fa-42fe-9a01-0fafb55cbb78", "bridge": "br-int", "label": "tempest-device-tagging-net1-179076245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f1b21e-12", "ovs_interfaceid": "a1f1b21e-12c3-4310-9ef0-791f4d09fc5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "address": "fa:16:3e:0f:a7:98", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989ec3b8-1a", "ovs_interfaceid": "989ec3b8-1a00-47b5-9a07-71f33cfb6c69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c97ac499-c8fa-412e-9452-c6f80e69c879", "address": "fa:16:3e:e3:15:e7", "network": {"id": "d3469945-df22-46a3-b22f-8f2b269fe93a", "bridge": "br-int", "label": "tempest-device-tagging-net2-148697105", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d530eb6a4bf04f468299323520f56d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc97ac499-c8", "ovs_interfaceid": "c97ac499-c8fa-412e-9452-c6f80e69c879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-56a72738-41d0-42d5-b70f-80cbc5fd9723 req-947aae01-3dad-477e-8f09-e9f2482ad40d service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Detach interface failed, port_id=0bbdcb7f-44fc-4144-9dcc-b82be1a036fd, reason: Instance e84c85a8-b97d-44ac-b0b3-f898860f5944 could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:10:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:25 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:25 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Took 3.66 seconds to deallocate network for instance.
Apr 13 15:10:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-deleted-6e4ead67-98a8-4a15-b31e-6ed9a0d075c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-deleted-a1f1b21e-12c3-4310-9ef0-791f4d09fc5f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-deleted-c97ac499-c8fa-412e-9452-c6f80e69c879 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-06b7e877-6126-4784-b839-4da06b43cedb req-c9a5cf4c-b78e-497e-bd91-b0a16f5197aa service nova] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Received event network-vif-deleted-989ec3b8-1a00-47b5-9a07-71f33cfb6c69 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZexjymJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '193136fc-e6c3-4e70-b7ab-01ced440c6bd', 'attached_at': '', 'detached_at': '', 'volume_id': '3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'serial': '3c648678-ad4b-4ce5-b267-ebf3abef2c5d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfvqpXCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '13c8ec19-b219-44c8-9c72-1a5a06e96d91'}, 'status': 'reserved', 'instance': '193136fc-e6c3-4e70-b7ab-01ced440c6bd', 'attached_at': '', 'detached_at': '', 'volume_id': '13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'serial'} {{(pid=71507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZexjymJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:26 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:26 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:26 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea8d407-d365-4c85-a358-fe04772d2585]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:10:26 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e21ae03-423e-4a9a-8599-c52225a11968]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d] added
Apr 13 15:10:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2567f59-e3ab-4cc9-bc83-09c54ef743ee]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[577bf94d-3c46-4c25-8857-ecd0131019e8]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZexjymJV {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZexjymJV" returned: 0 in 0.043s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[278b534b-694a-42f9-a78c-5fc34b596935]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZexjymJV'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff738548-c9cd-415a-b807-a782938aba34]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[01772723-7e17-467c-b9af-8722e63d1480]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:26 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:26 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3eca41-140e-469d-b71d-b08953e73709]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260]
Apr 13 15:10:26 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e361e9ea-b511-44a7-bbb9-7c47576e4faf]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c7bcfa-d72f-445e-a1b8-a6d6406067df]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:26 user nova-compute[71507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:26 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:26 user nova-compute[71507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:26 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0409997-4db6-4998-815d-40d0cfdfe6a0]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:10:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZexjymJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:10:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23266643462393061', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266643462393061', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:10:27 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lazy-loading 'flavor' on Instance uuid 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 69206016 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:29 user nova-compute[71507]: INFO nova.compute.manager [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Took 3.09 seconds to detach 3 volumes for instance.
Apr 13 15:10:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 127926272 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:29 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:10:29 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:10:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:29 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Deleted allocations for instance e84c85a8-b97d-44ac-b0b3-f898860f5944
Apr 13 15:10:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 271581184 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9b6b9681-8022-45c3-a6a5-ffd7834fe1f7 tempest-TaggedBootDevicesTest-1120084057 tempest-TaggedBootDevicesTest-1120084057-project-member] Lock "e84c85a8-b97d-44ac-b0b3-f898860f5944" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.550s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 394264576 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 514850816 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 597688320 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 746586112 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 892338176 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 1058013184 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfvqpXCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '13c8ec19-b219-44c8-9c72-1a5a06e96d91': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:33 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5a031d-ceba-40e1-ac72-b40843d3a7a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:10:33 user nova-compute[71507]: No targets found.
Apr 13 15:10:33 user nova-compute[71507]: iSNS:
Apr 13 15:10:33 user nova-compute[71507]: No targets found.
Apr 13 15:10:33 user nova-compute[71507]: STATIC:
Apr 13 15:10:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d
Apr 13 15:10:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91
Apr 13 15:10:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:10:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:33 user nova-compute[71507]: FIRMWARE:
Apr 13 15:10:33 user nova-compute[71507]: No targets found.
Apr 13 15:10:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:10:33 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:10:33 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07506325-897b-4efb-a9e3-e5aa89295e80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f965c1e5-4382-4200-9886-dd1df98d2d9b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:33 user nova-compute[71507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:33 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 (non-flash)
Apr 13 15:10:33 user nova-compute[71507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:33 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab2898b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91'): ({'sdh'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Removing single pathed devices sdh {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de35f2e-82f2-4d6f-bcb3-53e5420a87bc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c5fdd-e362-449e-aa56-0582bf68cb98]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Flushing IO for device /dev/sdh {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38f15ee-417e-41cd-8392-abefee392a60]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.056s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08533fd-e540-4794-a09b-34826882bed3]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] SCSI volumes sdh have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[679bd236-0c88-42d5-ae5d-8da7e3f8bf44]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbd8bf1-aea9-49f9-a7e8-adda88bd86db]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91, portal: 172.16.0.220,3260]
Apr 13 15:10:33 user nova-compute[71507]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c8ec19-b219-44c8-9c72-1a5a06e96d91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8892516-3202-4958-9b44-50958a28c794]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] <== disconnect_volume: return (316ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZexjymJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '193136fc-e6c3-4e70-b7ab-01ced440c6bd', 'attached_at': '', 'detached_at': '', 'volume_id': '3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'serial'} {{(pid=71507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] swap_volume: removing Cinder connection for volume 13c8ec19-b219-44c8-9c72-1a5a06e96d91 {{(pid=71507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "0a0a9548-9e57-4007-bafb-d418a4433473" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:10:34 user nova-compute[71507]: INFO nova.compute.claims [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Claim successful on node user
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:10:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:10:34 user nova-compute[71507]: INFO nova.virt.block_device [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Booting with blank volume at /dev/vda
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.policy [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] swap_volume: Updating volume 13c8ec19-b219-44c8-9c72-1a5a06e96d91 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ZexjymJV", "auth_password": "Kyj9JuCwqsDWrR", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "3c648678-ad4b-4ce5-b267-ebf3abef2c5d"}, "status": "reserved", "instance": "193136fc-e6c3-4e70-b7ab-01ced440c6bd", "attached_at": "", "detached_at": "", "volume_id": "3c648678-ad4b-4ce5-b267-ebf3abef2c5d", "serial": "3c648678-ad4b-4ce5-b267-ebf3abef2c5d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'no_device': None, 'attachment_id': 'd0a292e0-4bd2-4ef2-8f95-f995f110707a'} {{(pid=71507) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a622bb14-031b-4ecd-91b0-bf62bcef572c tempest-TestVolumeSwap-1366710945 tempest-TestVolumeSwap-1366710945-project-admin] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.678s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:34 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398619.973195, e84c85a8-b97d-44ac-b0b3-f898860f5944 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:10:34 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] VM Stopped (Lifecycle Event)
Apr 13 15:10:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-18aad38f-875e-4f00-a7b5-a209eb92a241 None None] [instance: e84c85a8-b97d-44ac-b0b3-f898860f5944] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Successfully created port: 0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:10:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:35 user nova-compute[71507]: INFO nova.compute.manager [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Detaching volume 3c648678-ad4b-4ce5-b267-ebf3abef2c5d
Apr 13 15:10:35 user nova-compute[71507]: INFO nova.virt.block_device [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Attempting to driver detach volume 3c648678-ad4b-4ce5-b267-ebf3abef2c5d from mountpoint /dev/vdb
Apr 13 15:10:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Attempting to detach device vdb from instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:10:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:10:35 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:10:35 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:10:35 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:10:35 user nova-compute[71507]:   <serial>3c648678-ad4b-4ce5-b267-ebf3abef2c5d</serial>
Apr 13 15:10:35 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:10:35 user nova-compute[71507]: </disk>
Apr 13 15:10:35 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:10:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Successfully detached device vdb from instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd from the persistent domain config.
Apr 13 15:10:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:10:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:10:35 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:10:35 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:10:35 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:10:35 user nova-compute[71507]:   <serial>3c648678-ad4b-4ce5-b267-ebf3abef2c5d</serial>
Apr 13 15:10:35 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:10:35 user nova-compute[71507]: </disk>
Apr 13 15:10:35 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681398636.1956897, 193136fc-e6c3-4e70-b7ab-01ced440c6bd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:10:36 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Successfully detached device vdb from instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd from the live domain config.
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZexjymJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '3c648678-ad4b-4ce5-b267-ebf3abef2c5d': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:36 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[773f5652-ee3a-48e3-be19-c5cec1af6dda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:10:36 user nova-compute[71507]: No targets found.
Apr 13 15:10:36 user nova-compute[71507]: iSNS:
Apr 13 15:10:36 user nova-compute[71507]: No targets found.
Apr 13 15:10:36 user nova-compute[71507]: STATIC:
Apr 13 15:10:36 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d
Apr 13 15:10:36 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:36 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:36 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:10:36 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:36 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:36 user nova-compute[71507]: FIRMWARE:
Apr 13 15:10:36 user nova-compute[71507]: No targets found.
Apr 13 15:10:36 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:10:36 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:10:36 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[644a6a85-f9bf-4d8a-9618-52a07aaee957]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[20422061-cfe2-4f7b-ab5e-2ee7607112e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:36 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:36 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d (non-flash)
Apr 13 15:10:36 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:36 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab28956290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Successfully updated port: 0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2963fdf-3f23-46d5-9844-942b5b57ddda]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquired lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f9be19-b90a-4485-bf12-864976cedff8]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-changed-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Refreshing instance network info cache due to event network-changed-0acacba1-f2ca-42c6-9ccb-bb3606bf706e. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] Acquiring lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a8fe29-1b2f-474b-86cb-f96d44882360]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc9fd5-9b63-49d9-8d56-2ec676c4326f]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b42e4fb-0bdb-4ab9-848d-a8d8eb336d6b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8270ffa3-620d-4542-b90c-bebadc49ad8d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260]
Apr 13 15:10:36 user nova-compute[71507]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:36 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c648678-ad4b-4ce5-b267-ebf3abef2c5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9711d9ce-7839-4a57-8dba-6d923bdccf52]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] <== disconnect_volume: return (327ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updating instance_info_cache with network_info: [{"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Releasing lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Instance network_info: |[{"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] Acquired lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Refreshing network info cache for port 0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:10:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updated VIF entry in instance network info cache for port 0acacba1-f2ca-42c6-9ccb-bb3606bf706e. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:10:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updating instance_info_cache with network_info: [{"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-756ffcbc-4f2d-441f-b35f-a7b31ed990b3 req-1b210e87-a35c-4006-a6d1-1c1afe6630ef service nova] Releasing lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:37 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lazy-loading 'flavor' on Instance uuid 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d53ee9-e545-4fa3-af70-ba0ebf73889b tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.814s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG os_brick.utils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e538de9b-97e7-41ba-a8ca-b404c83d516f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a869639-4840-4bca-9ef8-7c9e4bbfaf9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[73142d44-4698-4c08-9a72-9eece0e99d6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c0f0c3-a27a-43a2-93d4-0ad75751faba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:10:40 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:10:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9664da84-3eb7-49a4-9e3b-d6952d7ce72d]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG os_brick.utils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updating existing volume attachment record: 74bb6c51-38e0-4465-9e61-aa1625d9dcc8 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:10:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:10:44 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Creating image(s)
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Ensure instance console log exists: /opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Start _get_guest_xml network_info=[{"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEauhSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a0a9548-9e57-4007-bafb-d418a4433473', 'attached_at': '', 'detached_at': '', 'volume_id': '0c479ed5-b804-485c-a64f-90d780d66450', 'serial': '0c479ed5-b804-485c-a64f-90d780d66450'}, 'attachment_id': '74bb6c51-38e0-4465-9e61-aa1625d9dcc8', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:10:44 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:10:44 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEauhSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:44 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:44 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:44 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[52773351-27d0-4583-8188-2a4e1487ee74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:10:44 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ba16b6-992e-4e9b-841d-ec39b8b2f079]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450] added
Apr 13 15:10:44 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7703362-e1a2-464c-ac22-1b8c78fbfffb]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e9119a-2d46-4a32-acb9-8355cd9d1a60]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEauhSDY {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEauhSDY" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e075903f-d10f-46dd-aea2-15cd32d668e5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iEauhSDY'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cebde0-f5d8-48ce-9ad5-e4d29c284ef4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[871fcb39-ff39-4020-85be-830eaa5829cc]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e8146-43a0-4f50-bcfb-2da023c43ad5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450, portal: 172.16.0.220,3260]
Apr 13 15:10:45 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef031100-81a4-4add-ab62-2afb6f81779c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5528a486-ae1e-4370-986d-f9968e319833]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:10:45 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:10:45 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:45 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b315515-686e-40c4-b20c-aa80bab5f4a5]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEauhSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing instance network info cache due to event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] Acquiring lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] Acquired lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG nova.network.neutron [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:10:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:46 user nova-compute[71507]: INFO nova.compute.manager [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Shelve offloading
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.network.neutron [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updated VIF entry in instance network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.network.neutron [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating instance_info_cache with network_info: [{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3ed4a6ee-c269-41ce-8d40-2d78ea103bc0 req-35513afa-c155-45cb-b8fb-54df5bdbfcda service nova] Releasing lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23034313430653834', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034313430653834', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-370949425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-370949425',id=13,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-khfgpjah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:10:35Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=0a0a9548-9e57-4007-bafb-d418a4433473,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=0acacba1-f2ca-42c6-9ccb-bb3606bf706e,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acacba1-f2') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.objects.instance [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:10:46 user nova-compute[71507]:   <uuid>0a0a9548-9e57-4007-bafb-d418a4433473</uuid>
Apr 13 15:10:46 user nova-compute[71507]:   <name>instance-0000000d</name>
Apr 13 15:10:46 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:10:46 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:10:46 user nova-compute[71507]:   <metadata>
Apr 13 15:10:46 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:46 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:10:46 user nova-compute[71507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-370949425</nova:name>
Apr 13 15:10:46 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:10:44</nova:creationTime>
Apr 13 15:10:46 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:10:46 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:10:46 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:10:46 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:10:46 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:46 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:46 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:10:46 user nova-compute[71507]:       <nova:owner>
Apr 13 15:10:46 user nova-compute[71507]:         <nova:user uuid="75bf6e19993f4c2e90fd52c4d6212622">tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member</nova:user>
Apr 13 15:10:46 user nova-compute[71507]:         <nova:project uuid="240b28f42732478ba732994b2c9e3fbe">tempest-ServerBootFromVolumeStableRescueTest-1009244781</nova:project>
Apr 13 15:10:46 user nova-compute[71507]:       </nova:owner>
Apr 13 15:10:46 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:46 user nova-compute[71507]:       <nova:ports>
Apr 13 15:10:46 user nova-compute[71507]:         <nova:port uuid="0acacba1-f2ca-42c6-9ccb-bb3606bf706e">
Apr 13 15:10:46 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 15:10:46 user nova-compute[71507]:         </nova:port>
Apr 13 15:10:46 user nova-compute[71507]:       </nova:ports>
Apr 13 15:10:46 user nova-compute[71507]:     </nova:instance>
Apr 13 15:10:46 user nova-compute[71507]:   </metadata>
Apr 13 15:10:46 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:10:46 user nova-compute[71507]:     <system>
Apr 13 15:10:46 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:10:46 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:10:46 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:10:46 user nova-compute[71507]:       <entry name="serial">0a0a9548-9e57-4007-bafb-d418a4433473</entry>
Apr 13 15:10:46 user nova-compute[71507]:       <entry name="uuid">0a0a9548-9e57-4007-bafb-d418a4433473</entry>
Apr 13 15:10:46 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:10:46 user nova-compute[71507]:     </system>
Apr 13 15:10:46 user nova-compute[71507]:   </sysinfo>
Apr 13 15:10:46 user nova-compute[71507]:   <os>
Apr 13 15:10:46 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:10:46 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:10:46 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:10:46 user nova-compute[71507]:   </os>
Apr 13 15:10:46 user nova-compute[71507]:   <features>
Apr 13 15:10:46 user nova-compute[71507]:     <acpi/>
Apr 13 15:10:46 user nova-compute[71507]:     <apic/>
Apr 13 15:10:46 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:10:46 user nova-compute[71507]:   </features>
Apr 13 15:10:46 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:10:46 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:10:46 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:10:46 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:10:46 user nova-compute[71507]:   </clock>
Apr 13 15:10:46 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:10:46 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:10:46 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:10:46 user nova-compute[71507]:   </cpu>
Apr 13 15:10:46 user nova-compute[71507]:   <devices>
Apr 13 15:10:46 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:10:46 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:10:46 user nova-compute[71507]:       <source dev="/dev/sdb"/>
Apr 13 15:10:46 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:10:46 user nova-compute[71507]:       <serial>0c479ed5-b804-485c-a64f-90d780d66450</serial>
Apr 13 15:10:46 user nova-compute[71507]:     </disk>
Apr 13 15:10:46 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:10:46 user nova-compute[71507]:       <mac address="fa:16:3e:37:e4:e9"/>
Apr 13 15:10:46 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:10:46 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:10:46 user nova-compute[71507]:       <target dev="tap0acacba1-f2"/>
Apr 13 15:10:46 user nova-compute[71507]:     </interface>
Apr 13 15:10:46 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:10:46 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/console.log" append="off"/>
Apr 13 15:10:46 user nova-compute[71507]:     </serial>
Apr 13 15:10:46 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:10:46 user nova-compute[71507]:     <video>
Apr 13 15:10:46 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:10:46 user nova-compute[71507]:     </video>
Apr 13 15:10:46 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:10:46 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:10:46 user nova-compute[71507]:     </rng>
Apr 13 15:10:46 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:10:46 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:10:46 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:10:46 user nova-compute[71507]:     </memballoon>
Apr 13 15:10:46 user nova-compute[71507]:   </devices>
Apr 13 15:10:46 user nova-compute[71507]: </domain>
Apr 13 15:10:46 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-370949425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-370949425',id=13,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-khfgpjah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:10:35Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=0a0a9548-9e57-4007-bafb-d418a4433473,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=0acacba1-f2ca-42c6-9ccb-bb3606bf706e,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acacba1-f2') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG os_vif [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=0acacba1-f2ca-42c6-9ccb-bb3606bf706e,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acacba1-f2') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0acacba1-f2, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0acacba1-f2, col_values=(('external_ids', {'iface-id': '0acacba1-f2ca-42c6-9ccb-bb3606bf706e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:e4:e9', 'vm-uuid': '0a0a9548-9e57-4007-bafb-d418a4433473'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:46 user nova-compute[71507]: INFO os_vif [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=0acacba1-f2ca-42c6-9ccb-bb3606bf706e,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acacba1-f2')
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No VIF found with MAC fa:16:3e:37:e4:e9, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-unplugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] No waiting events found dispatching network-vif-unplugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:46 user nova-compute[71507]: WARNING nova.compute.manager [req-ac9e9546-a8e8-4979-bf98-122093ff830e req-192e8dd7-6722-4070-8331-23b3f82debf4 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received unexpected event network-vif-unplugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance with vm_state active and task_state shelving.
Apr 13 15:10:47 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Instance destroyed successfully.
Apr 13 15:10:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquired lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:47 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:10:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:47 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating instance_info_cache with network_info: [{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Releasing lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:48 user nova-compute[71507]: WARNING nova.compute.manager [req-1fce4a8d-efeb-43d9-9683-c163b12534f1 req-f14586e6-9502-4eb9-a531-ba6ac35f1212 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state building and task_state spawning.
Apr 13 15:10:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] No waiting events found dispatching network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:48 user nova-compute[71507]: WARNING nova.compute.manager [req-efe32f40-3db3-42a8-a2f8-536fb98138ca req-df34ce21-464b-4a22-86fc-90d598fb5ad4 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received unexpected event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance with vm_state active and task_state shelving.
Apr 13 15:10:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Instance destroyed successfully.
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lazy-loading 'resources' on Instance uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-411290166',display_name='tempest-TestShelveInstance-server-411290166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-411290166',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMiNMWIbugIqPibluDtkgkNEHAz0dy1D5iz8h+LzuOQnT0xmd5kr4yKVwXHq5lSKq5W4WLRwRbSWAGEOzySrgPdrDDGPAIFjjmc2lQ7zaPxRPWJoiG7d4rgdJ1tvZwk/g==',key_name='tempest-TestShelveInstance-771163491',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:09:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7227559570b54e92be19d25938523b49',ramdisk_id='',reservation_id='r-btkem4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1754998277',owner_user_name='tempest-TestShelveInstance-1754998277-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:09:05Z,user_data=None,user_id='2fc0cce3df7540078438186f46ca4621',uuid=179b6945-589d-402c-a89e-6b8d68725211,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converting VIF {"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_vif [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing instance network info cache due to event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] Acquiring lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] Acquired lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.network.neutron [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6a42460-29, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:48 user nova-compute[71507]: INFO os_vif [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29')
Apr 13 15:10:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFEgzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:10:48 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[44379d40-a3d1-4140-ba1e-d084c4eb68c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:10:48 user nova-compute[71507]: No targets found.
Apr 13 15:10:48 user nova-compute[71507]: iSNS:
Apr 13 15:10:48 user nova-compute[71507]: No targets found.
Apr 13 15:10:48 user nova-compute[71507]: STATIC:
Apr 13 15:10:48 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:10:48 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:48 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:48 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:10:48 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:10:48 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:10:48 user nova-compute[71507]: FIRMWARE:
Apr 13 15:10:48 user nova-compute[71507]: No targets found.
Apr 13 15:10:48 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:10:48 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:10:48 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a7e850-2da3-440c-b61e-6a41f7ee69eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f2d193-810c-4168-9344-6056200c2679]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:10:48 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:48 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:10:48 user nova-compute[71507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:10:48 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c660160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961'): ({'sde'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Removing single pathed devices sde {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0679b3-0133-486d-a137-6c0bf9a0913e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1ab0e2-f2b8-4213-a290-5db0f91facd8]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Flushing IO for device /dev/sde {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[746c6b6d-34fb-43e7-842f-42483cc53542]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:10:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b479afa6-7dca-4d9d-8491-62999cc1aa02]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2675df1d-d1c5-4f0f-811a-5b89a71cb33a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc66f4-9a03-4b26-b311-fa08444c02d2]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260]
Apr 13 15:10:49 user nova-compute[71507]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260] successful.
Apr 13 15:10:49 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8573e8bb-9dfd-4cbf-9c47-af1ee1951beb]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] <== disconnect_volume: return (334ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:10:49 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Deleting instance files /opt/stack/data/nova/instances/179b6945-589d-402c-a89e-6b8d68725211_del
Apr 13 15:10:49 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Deletion of /opt/stack/data/nova/instances/179b6945-589d-402c-a89e-6b8d68725211_del complete
Apr 13 15:10:49 user nova-compute[71507]: DEBUG nova.network.neutron [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updated VIF entry in instance network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG nova.network.neutron [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating instance_info_cache with network_info: [{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": null, "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb6a42460-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-193004e0-26bd-4396-8dfb-4378ebad7462 req-aa016a49-1074-40c3-9fdf-b1512e821e50 service nova] Releasing lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:50 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Deleted allocations for instance 179b6945-589d-402c-a89e-6b8d68725211
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lazy-loading 'numa_topology' on Instance uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398650.3378432, 0a0a9548-9e57-4007-bafb-d418a4433473 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:10:50 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] VM Resumed (Lifecycle Event)
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:10:50 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Instance spawned successfully.
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:50 user nova-compute[71507]: WARNING nova.compute.manager [req-bbca55ad-1614-4bd4-9bc7-8096c3ab439e req-3c5ca4ef-0e1e-49a1-b3cc-be07992bda34 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state building and task_state spawning.
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:10:50 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398650.3392754, 0a0a9548-9e57-4007-bafb-d418a4433473 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:10:50 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] VM Started (Lifecycle Event)
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:10:50 user nova-compute[71507]: INFO nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Took 5.67 seconds to spawn the instance on the hypervisor.
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "1c9a3524-caeb-4333-ae2b-1080115026fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:10:50 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a96544a9-f651-459f-86ae-6d473bb64e88 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.516s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:50 user nova-compute[71507]: INFO nova.compute.manager [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Took 16.55 seconds to build instance.
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cf73eda9-7c9b-44ce-8414-76447c4f8a11 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "0a0a9548-9e57-4007-bafb-d418a4433473" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.650s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:10:50 user nova-compute[71507]: INFO nova.compute.claims [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Claim successful on node user
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:10:51 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.policy [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bdc942f33ca46c08bb143ed2efeb458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0cae04ab4b4157a7ef786d165789a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:10:51 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Creating image(s)
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "/opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "/opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk 1073741824" returned: 0 in 0.055s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Successfully created port: 575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Cannot resize image /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lazy-loading 'migration_context' on Instance uuid 1c9a3524-caeb-4333-ae2b-1080115026fd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Ensure instance console log exists: /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Successfully updated port: 575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "refresh_cache-1c9a3524-caeb-4333-ae2b-1080115026fd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquired lock "refresh_cache-1c9a3524-caeb-4333-ae2b-1080115026fd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received event network-changed-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Refreshing instance network info cache due to event network-changed-575668b5-eb5b-4275-962a-db577c3931a0. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] Acquiring lock "refresh_cache-1c9a3524-caeb-4333-ae2b-1080115026fd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:10:52 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Updating instance_info_cache with network_info: [{"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Releasing lock "refresh_cache-1c9a3524-caeb-4333-ae2b-1080115026fd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Instance network_info: |[{"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] Acquired lock "refresh_cache-1c9a3524-caeb-4333-ae2b-1080115026fd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Refreshing network info cache for port 575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Start _get_guest_xml network_info=[{"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:10:53 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:10:53 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1114961218',display_name='tempest-VolumesActionsTest-instance-1114961218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1114961218',id=14,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c0cae04ab4b4157a7ef786d165789a6',ramdisk_id='',reservation_id='r-0fd29a81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-119634704',owner_user_name='tempest-VolumesActionsTest-119634704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:10:51Z,user_data=None,user_id='3bdc942f33ca46c08bb143ed2efeb458',uuid=1c9a3524-caeb-4333-ae2b-1080115026fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converting VIF {"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=575668b5-eb5b-4275-962a-db577c3931a0,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575668b5-eb') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c9a3524-caeb-4333-ae2b-1080115026fd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:10:53 user nova-compute[71507]:   <uuid>1c9a3524-caeb-4333-ae2b-1080115026fd</uuid>
Apr 13 15:10:53 user nova-compute[71507]:   <name>instance-0000000e</name>
Apr 13 15:10:53 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:10:53 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:10:53 user nova-compute[71507]:   <metadata>
Apr 13 15:10:53 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:53 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:10:53 user nova-compute[71507]:       <nova:name>tempest-VolumesActionsTest-instance-1114961218</nova:name>
Apr 13 15:10:53 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:10:53</nova:creationTime>
Apr 13 15:10:53 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:10:53 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:10:53 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:10:53 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:10:53 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:53 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:53 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:10:53 user nova-compute[71507]:       <nova:owner>
Apr 13 15:10:53 user nova-compute[71507]:         <nova:user uuid="3bdc942f33ca46c08bb143ed2efeb458">tempest-VolumesActionsTest-119634704-project-member</nova:user>
Apr 13 15:10:53 user nova-compute[71507]:         <nova:project uuid="2c0cae04ab4b4157a7ef786d165789a6">tempest-VolumesActionsTest-119634704</nova:project>
Apr 13 15:10:53 user nova-compute[71507]:       </nova:owner>
Apr 13 15:10:53 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:53 user nova-compute[71507]:       <nova:ports>
Apr 13 15:10:53 user nova-compute[71507]:         <nova:port uuid="575668b5-eb5b-4275-962a-db577c3931a0">
Apr 13 15:10:53 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 15:10:53 user nova-compute[71507]:         </nova:port>
Apr 13 15:10:53 user nova-compute[71507]:       </nova:ports>
Apr 13 15:10:53 user nova-compute[71507]:     </nova:instance>
Apr 13 15:10:53 user nova-compute[71507]:   </metadata>
Apr 13 15:10:53 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:10:53 user nova-compute[71507]:     <system>
Apr 13 15:10:53 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:10:53 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:10:53 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:10:53 user nova-compute[71507]:       <entry name="serial">1c9a3524-caeb-4333-ae2b-1080115026fd</entry>
Apr 13 15:10:53 user nova-compute[71507]:       <entry name="uuid">1c9a3524-caeb-4333-ae2b-1080115026fd</entry>
Apr 13 15:10:53 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:10:53 user nova-compute[71507]:     </system>
Apr 13 15:10:53 user nova-compute[71507]:   </sysinfo>
Apr 13 15:10:53 user nova-compute[71507]:   <os>
Apr 13 15:10:53 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:10:53 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:10:53 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:10:53 user nova-compute[71507]:   </os>
Apr 13 15:10:53 user nova-compute[71507]:   <features>
Apr 13 15:10:53 user nova-compute[71507]:     <acpi/>
Apr 13 15:10:53 user nova-compute[71507]:     <apic/>
Apr 13 15:10:53 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:10:53 user nova-compute[71507]:   </features>
Apr 13 15:10:53 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:10:53 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:10:53 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:10:53 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:10:53 user nova-compute[71507]:   </clock>
Apr 13 15:10:53 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:10:53 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:10:53 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:10:53 user nova-compute[71507]:   </cpu>
Apr 13 15:10:53 user nova-compute[71507]:   <devices>
Apr 13 15:10:53 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:10:53 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:10:53 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk"/>
Apr 13 15:10:53 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:10:53 user nova-compute[71507]:     </disk>
Apr 13 15:10:53 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:10:53 user nova-compute[71507]:       <mac address="fa:16:3e:78:00:e0"/>
Apr 13 15:10:53 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:10:53 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:10:53 user nova-compute[71507]:       <target dev="tap575668b5-eb"/>
Apr 13 15:10:53 user nova-compute[71507]:     </interface>
Apr 13 15:10:53 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:10:53 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/console.log" append="off"/>
Apr 13 15:10:53 user nova-compute[71507]:     </serial>
Apr 13 15:10:53 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:10:53 user nova-compute[71507]:     <video>
Apr 13 15:10:53 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:10:53 user nova-compute[71507]:     </video>
Apr 13 15:10:53 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:10:53 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:10:53 user nova-compute[71507]:     </rng>
Apr 13 15:10:53 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:10:53 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:10:53 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:10:53 user nova-compute[71507]:     </memballoon>
Apr 13 15:10:53 user nova-compute[71507]:   </devices>
Apr 13 15:10:53 user nova-compute[71507]: </domain>
Apr 13 15:10:53 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1114961218',display_name='tempest-VolumesActionsTest-instance-1114961218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1114961218',id=14,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c0cae04ab4b4157a7ef786d165789a6',ramdisk_id='',reservation_id='r-0fd29a81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-119634704',owner_user_name='tempest-VolumesActionsTest-119634704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:10:51Z,user_data=None,user_id='3bdc942f33ca46c08bb143ed2efeb458',uuid=1c9a3524-caeb-4333-ae2b-1080115026fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converting VIF {"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=575668b5-eb5b-4275-962a-db577c3931a0,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575668b5-eb') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG os_vif [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=575668b5-eb5b-4275-962a-db577c3931a0,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575668b5-eb') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap575668b5-eb, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap575668b5-eb, col_values=(('external_ids', {'iface-id': '575668b5-eb5b-4275-962a-db577c3931a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:00:e0', 'vm-uuid': '1c9a3524-caeb-4333-ae2b-1080115026fd'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:53 user nova-compute[71507]: INFO os_vif [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=575668b5-eb5b-4275-962a-db577c3931a0,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575668b5-eb')
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] No VIF found with MAC fa:16:3e:78:00:e0, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:10:53 user nova-compute[71507]: INFO nova.compute.claims [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Claim successful on node user
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Updated VIF entry in instance network info cache for port 575668b5-eb5b-4275-962a-db577c3931a0. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Updating instance_info_cache with network_info: [{"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61ddab6c-0087-4735-9709-93ae434ebdc9 req-c69fa3e9-d798-46ff-b763-7bf801bd433d service nova] Releasing lock "refresh_cache-1c9a3524-caeb-4333-ae2b-1080115026fd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.network.neutron [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:10:53 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.policy [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54b07929cf2c404ab10ce944437e9e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7b81912360422a8413f8760b0cf7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:10:53 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Creating image(s)
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "/opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "/opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk 1073741824" returned: 0 in 0.058s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.187s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG nova.network.neutron [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Successfully created port: 4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Cannot resize image /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG nova.objects.instance [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'migration_context' on Instance uuid bfc41492-c482-4a9f-8a5b-9d7520dea39a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Ensure instance console log exists: /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received event network-vif-plugged-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] Acquiring lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] No waiting events found dispatching network-vif-plugged-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:55 user nova-compute[71507]: WARNING nova.compute.manager [req-bdd1b4de-1873-4087-8c87-8196f90cb26b req-3753e342-be87-47f4-b44b-9fb22f897d27 service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received unexpected event network-vif-plugged-575668b5-eb5b-4275-962a-db577c3931a0 for instance with vm_state building and task_state spawning.
Apr 13 15:10:55 user nova-compute[71507]: DEBUG nova.network.neutron [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Successfully updated port: 4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "refresh_cache-bfc41492-c482-4a9f-8a5b-9d7520dea39a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquired lock "refresh_cache-bfc41492-c482-4a9f-8a5b-9d7520dea39a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG nova.network.neutron [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received event network-changed-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Refreshing instance network info cache due to event network-changed-4251e566-faf6-4d5a-a5be-048443db64db. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] Acquiring lock "refresh_cache-bfc41492-c482-4a9f-8a5b-9d7520dea39a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG nova.network.neutron [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:10:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.network.neutron [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Updating instance_info_cache with network_info: [{"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Releasing lock "refresh_cache-bfc41492-c482-4a9f-8a5b-9d7520dea39a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Instance network_info: |[{"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] Acquired lock "refresh_cache-bfc41492-c482-4a9f-8a5b-9d7520dea39a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Refreshing network info cache for port 4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Start _get_guest_xml network_info=[{"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:10:56 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:10:56 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-548228514',display_name='tempest-VolumesAdminNegativeTest-server-548228514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-548228514',id=15,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7b81912360422a8413f8760b0cf7e1',ramdisk_id='',reservation_id='r-o2c7gqwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-721367972',owner_user_name='tempest-VolumesAdminNegativeTest-721367972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:10:54Z,user_data=None,user_id='54b07929cf2c404ab10ce944437e9e97',uuid=bfc41492-c482-4a9f-8a5b-9d7520dea39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converting VIF {"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:db,bridge_name='br-int',has_traffic_filtering=True,id=4251e566-faf6-4d5a-a5be-048443db64db,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4251e566-fa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.objects.instance [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'pci_devices' on Instance uuid bfc41492-c482-4a9f-8a5b-9d7520dea39a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:10:56 user nova-compute[71507]:   <uuid>bfc41492-c482-4a9f-8a5b-9d7520dea39a</uuid>
Apr 13 15:10:56 user nova-compute[71507]:   <name>instance-0000000f</name>
Apr 13 15:10:56 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:10:56 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:10:56 user nova-compute[71507]:   <metadata>
Apr 13 15:10:56 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:10:56 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:10:56 user nova-compute[71507]:       <nova:name>tempest-VolumesAdminNegativeTest-server-548228514</nova:name>
Apr 13 15:10:56 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:10:56</nova:creationTime>
Apr 13 15:10:56 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:10:56 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:10:56 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:10:56 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:10:56 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:10:56 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:10:56 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:10:56 user nova-compute[71507]:       <nova:owner>
Apr 13 15:10:56 user nova-compute[71507]:         <nova:user uuid="54b07929cf2c404ab10ce944437e9e97">tempest-VolumesAdminNegativeTest-721367972-project-member</nova:user>
Apr 13 15:10:56 user nova-compute[71507]:         <nova:project uuid="8f7b81912360422a8413f8760b0cf7e1">tempest-VolumesAdminNegativeTest-721367972</nova:project>
Apr 13 15:10:56 user nova-compute[71507]:       </nova:owner>
Apr 13 15:10:56 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:10:56 user nova-compute[71507]:       <nova:ports>
Apr 13 15:10:56 user nova-compute[71507]:         <nova:port uuid="4251e566-faf6-4d5a-a5be-048443db64db">
Apr 13 15:10:56 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 15:10:56 user nova-compute[71507]:         </nova:port>
Apr 13 15:10:56 user nova-compute[71507]:       </nova:ports>
Apr 13 15:10:56 user nova-compute[71507]:     </nova:instance>
Apr 13 15:10:56 user nova-compute[71507]:   </metadata>
Apr 13 15:10:56 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:10:56 user nova-compute[71507]:     <system>
Apr 13 15:10:56 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:10:56 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:10:56 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:10:56 user nova-compute[71507]:       <entry name="serial">bfc41492-c482-4a9f-8a5b-9d7520dea39a</entry>
Apr 13 15:10:56 user nova-compute[71507]:       <entry name="uuid">bfc41492-c482-4a9f-8a5b-9d7520dea39a</entry>
Apr 13 15:10:56 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:10:56 user nova-compute[71507]:     </system>
Apr 13 15:10:56 user nova-compute[71507]:   </sysinfo>
Apr 13 15:10:56 user nova-compute[71507]:   <os>
Apr 13 15:10:56 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:10:56 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:10:56 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:10:56 user nova-compute[71507]:   </os>
Apr 13 15:10:56 user nova-compute[71507]:   <features>
Apr 13 15:10:56 user nova-compute[71507]:     <acpi/>
Apr 13 15:10:56 user nova-compute[71507]:     <apic/>
Apr 13 15:10:56 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:10:56 user nova-compute[71507]:   </features>
Apr 13 15:10:56 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:10:56 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:10:56 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:10:56 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:10:56 user nova-compute[71507]:   </clock>
Apr 13 15:10:56 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:10:56 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:10:56 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:10:56 user nova-compute[71507]:   </cpu>
Apr 13 15:10:56 user nova-compute[71507]:   <devices>
Apr 13 15:10:56 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:10:56 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:10:56 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk"/>
Apr 13 15:10:56 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:10:56 user nova-compute[71507]:     </disk>
Apr 13 15:10:56 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:10:56 user nova-compute[71507]:       <mac address="fa:16:3e:d1:ae:db"/>
Apr 13 15:10:56 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:10:56 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:10:56 user nova-compute[71507]:       <target dev="tap4251e566-fa"/>
Apr 13 15:10:56 user nova-compute[71507]:     </interface>
Apr 13 15:10:56 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:10:56 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/console.log" append="off"/>
Apr 13 15:10:56 user nova-compute[71507]:     </serial>
Apr 13 15:10:56 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:10:56 user nova-compute[71507]:     <video>
Apr 13 15:10:56 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:10:56 user nova-compute[71507]:     </video>
Apr 13 15:10:56 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:10:56 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:10:56 user nova-compute[71507]:     </rng>
Apr 13 15:10:56 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:10:56 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:10:56 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:10:56 user nova-compute[71507]:     </memballoon>
Apr 13 15:10:56 user nova-compute[71507]:   </devices>
Apr 13 15:10:56 user nova-compute[71507]: </domain>
Apr 13 15:10:56 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-548228514',display_name='tempest-VolumesAdminNegativeTest-server-548228514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-548228514',id=15,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7b81912360422a8413f8760b0cf7e1',ramdisk_id='',reservation_id='r-o2c7gqwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-721367972',owner_user_name='tempest-VolumesAdminNegativeTest-721367972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:10:54Z,user_data=None,user_id='54b07929cf2c404ab10ce944437e9e97',uuid=bfc41492-c482-4a9f-8a5b-9d7520dea39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converting VIF {"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:db,bridge_name='br-int',has_traffic_filtering=True,id=4251e566-faf6-4d5a-a5be-048443db64db,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4251e566-fa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG os_vif [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:db,bridge_name='br-int',has_traffic_filtering=True,id=4251e566-faf6-4d5a-a5be-048443db64db,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4251e566-fa') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4251e566-fa, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4251e566-fa, col_values=(('external_ids', {'iface-id': '4251e566-faf6-4d5a-a5be-048443db64db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:ae:db', 'vm-uuid': 'bfc41492-c482-4a9f-8a5b-9d7520dea39a'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:56 user nova-compute[71507]: INFO os_vif [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:db,bridge_name='br-int',has_traffic_filtering=True,id=4251e566-faf6-4d5a-a5be-048443db64db,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4251e566-fa')
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] No VIF found with MAC fa:16:3e:d1:ae:db, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Updated VIF entry in instance network info cache for port 4251e566-faf6-4d5a-a5be-048443db64db. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Updating instance_info_cache with network_info: [{"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-20efd936-f614-4c67-810a-4738041c4a92 req-57fa0b71-b080-4be2-a529-f1dcfda7cbf3 service nova] Releasing lock "refresh_cache-bfc41492-c482-4a9f-8a5b-9d7520dea39a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398656.9165843, 1c9a3524-caeb-4333-ae2b-1080115026fd => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:10:56 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] VM Resumed (Lifecycle Event)
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:56 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Instance spawned successfully.
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:10:56 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:10:56 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398656.920955, 1c9a3524-caeb-4333-ae2b-1080115026fd => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:10:56 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] VM Started (Lifecycle Event)
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:10:57 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:10:57 user nova-compute[71507]: INFO nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Took 5.88 seconds to spawn the instance on the hypervisor.
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:10:57 user nova-compute[71507]: INFO nova.compute.manager [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Took 6.57 seconds to build instance.
Apr 13 15:10:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7ed9958-ceb3-46ab-b3cf-7ee8b7e03a27 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.683s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received event network-vif-plugged-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] Acquiring lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] No waiting events found dispatching network-vif-plugged-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:57 user nova-compute[71507]: WARNING nova.compute.manager [req-31f22b7d-3a7c-4d6a-bca0-7a1ad5a0bc18 req-bc3e0795-06be-47af-997a-c752069d6bad service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received unexpected event network-vif-plugged-575668b5-eb5b-4275-962a-db577c3931a0 for instance with vm_state active and task_state None.
Apr 13 15:10:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received event network-vif-plugged-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] Acquiring lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:10:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] No waiting events found dispatching network-vif-plugged-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:10:57 user nova-compute[71507]: WARNING nova.compute.manager [req-b8a4ab26-34f7-46ed-bcad-1d1b49efa938 req-4b54170a-55d2-4e96-a212-a21b1ed94ba7 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received unexpected event network-vif-plugged-4251e566-faf6-4d5a-a5be-048443db64db for instance with vm_state building and task_state spawning.
Apr 13 15:10:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received event network-vif-plugged-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] Acquiring lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] No waiting events found dispatching network-vif-plugged-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:00 user nova-compute[71507]: WARNING nova.compute.manager [req-d9efc0b4-2d86-4f93-b7e5-3c37c91da8e9 req-a847f671-9935-46b0-9da9-1fdc3e3a7d62 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received unexpected event network-vif-plugged-4251e566-faf6-4d5a-a5be-048443db64db for instance with vm_state building and task_state spawning.
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398660.0881674, bfc41492-c482-4a9f-8a5b-9d7520dea39a => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:00 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] VM Resumed (Lifecycle Event)
Apr 13 15:11:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Instance spawned successfully.
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:11:00 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398660.089664, bfc41492-c482-4a9f-8a5b-9d7520dea39a => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:00 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] VM Started (Lifecycle Event)
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:11:00 user nova-compute[71507]: INFO nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 13 15:11:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:00 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:11:00 user nova-compute[71507]: INFO nova.compute.manager [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Took 7.14 seconds to build instance.
Apr 13 15:11:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-316c1810-40ae-44fa-ad44-5b514d2939c3 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.257s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:02 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398647.388593, 179b6945-589d-402c-a89e-6b8d68725211 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:02 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] VM Stopped (Lifecycle Event)
Apr 13 15:11:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-4639b477-1a70-4b62-b029-de32078b0b0c None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:07 user nova-compute[71507]: INFO nova.compute.manager [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Terminating instance
Apr 13 15:11:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-unplugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] No waiting events found dispatching network-vif-unplugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-7108c170-6f32-409b-a7ac-fc3d69013614 req-cc23f884-c497-4c8e-b595-284446b1404f service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-unplugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Instance destroyed successfully.
Apr 13 15:11:07 user nova-compute[71507]: DEBUG nova.objects.instance [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lazy-loading 'resources' on Instance uuid 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055562483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2055562483',id=10,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBq9S0cYEjOdCELWE2pKguGrXbpsmvgxJBR+qOuiE9S1dyELdofxdi/TTNTfkVSGHEbBC+G3lepo5cFG2wkiBLOH0DBLXClHmHJvcIb9z3NLVlO9t78kWhP1T9srfjA+A==',key_name='tempest-keypair-1905935028',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be23bf27d7ed4f0abf2fdc60ae1edb71',ramdisk_id='',reservation_id='r-wj2y7pak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-227294207',owner_user_name='tempest-TaggedAttachmentsTest-227294207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b59f4d6492a4821a621b18766bf58fa',uuid=95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converting VIF {"id": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "address": "fa:16:3e:cd:1d:8a", "network": {"id": "4f48b4f3-f64b-428b-b729-0d4305647e89", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1135866009-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be23bf27d7ed4f0abf2fdc60ae1edb71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce8e302f-1f", "ovs_interfaceid": "ce8e302f-1f0b-46e0-82ef-9809a6ad81db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:1d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ce8e302f-1f0b-46e0-82ef-9809a6ad81db,network=Network(4f48b4f3-f64b-428b-b729-0d4305647e89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce8e302f-1f') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG os_vif [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:1d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ce8e302f-1f0b-46e0-82ef-9809a6ad81db,network=Network(4f48b4f3-f64b-428b-b729-0d4305647e89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce8e302f-1f') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce8e302f-1f, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:11:07 user nova-compute[71507]: INFO os_vif [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:1d:8a,bridge_name='br-int',has_traffic_filtering=True,id=ce8e302f-1f0b-46e0-82ef-9809a6ad81db,network=Network(4f48b4f3-f64b-428b-b729-0d4305647e89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce8e302f-1f')
Apr 13 15:11:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Deleting instance files /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc_del
Apr 13 15:11:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Deletion of /opt/stack/data/nova/instances/95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc_del complete
Apr 13 15:11:08 user nova-compute[71507]: INFO nova.compute.manager [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 15:11:08 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:11:08 user nova-compute[71507]: INFO nova.compute.claims [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Claim successful on node user
Apr 13 15:11:08 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:11:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:11:09 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Took 1.07 seconds to deallocate network for instance.
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-ed112440-e3db-4d35-9832-ad866e8cd81e req-f95bde00-f769-4761-9bcb-fe2dc16ea1e0 service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-deleted-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.policy [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:11:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Creating image(s)
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "/opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "/opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "/opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "c7432199be95c303a0a9c8e65c1330ec691d6c84" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "c7432199be95c303a0a9c8e65c1330ec691d6c84" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received event network-vif-plugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] Acquiring lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] No waiting events found dispatching network-vif-plugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:09 user nova-compute[71507]: WARNING nova.compute.manager [req-494a9dc3-a151-4fac-9d26-690f154663e0 req-35b52776-132a-42de-aaf4-23c7e27e004c service nova] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Received unexpected event network-vif-plugged-ce8e302f-1f0b-46e0-82ef-9809a6ad81db for instance with vm_state deleted and task_state None.
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84.part --force-share --output=json" returned: 0 in 0.173s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.virt.images [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] be4d330c-57e5-4ce4-afe8-c2b8be481516 was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84.part /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Successfully created port: f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:11:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84.part /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84.converted" returned: 0 in 0.187s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.887s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:10 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Deleted allocations for instance 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "c7432199be95c303a0a9c8e65c1330ec691d6c84" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.955s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-615b1156-b8f7-4cde-bc37-1ca7c2b2235e tempest-TaggedAttachmentsTest-227294207 tempest-TaggedAttachmentsTest-227294207-project-member] Lock "95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.139s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84 --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "c7432199be95c303a0a9c8e65c1330ec691d6c84" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "c7432199be95c303a0a9c8e65c1330ec691d6c84" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84 --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84,backing_fmt=raw /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84,backing_fmt=raw /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk 1073741824" returned: 0 in 0.085s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "c7432199be95c303a0a9c8e65c1330ec691d6c84" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG nova.network.neutron [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Successfully updated port: f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquired lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG nova.network.neutron [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84 --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG nova.network.neutron [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Cannot resize image /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG nova.objects.instance [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'migration_context' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Ensure instance console log exists: /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing instance network info cache due to event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] Acquiring lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.network.neutron [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updating instance_info_cache with network_info: [{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Releasing lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Instance network_info: |[{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] Acquired lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Start _get_guest_xml network_info=[{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:11:05Z,direct_url=<?>,disk_format='qcow2',id=be4d330c-57e5-4ce4-afe8-c2b8be481516,min_disk=0,min_ram=0,name='tempest-scenario-img--320675461',owner='738150b0ec0c4ce887397f161c7e8c21',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:11:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': 'be4d330c-57e5-4ce4-afe8-c2b8be481516'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:11:11 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:11:11 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:11:05Z,direct_url=<?>,disk_format='qcow2',id=be4d330c-57e5-4ce4-afe8-c2b8be481516,min_disk=0,min_ram=0,name='tempest-scenario-img--320675461',owner='738150b0ec0c4ce887397f161c7e8c21',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:11:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-377290664',display_name='tempest-TestMinimumBasicScenario-server-377290664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-377290664',id=16,image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2KhvSB5J03IhhEg5JA/tj1cG2BDSPmL+5jFj0Unl3L4uq4s1XIJI5/ab1Vik7nfl+6oJRIw2tTNA1sr/iUc9YAfC+JNpGyE3k2x1hnrhzYW5YHXhMGc7caYhQEORU1KQ==',key_name='tempest-TestMinimumBasicScenario-1980539872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='738150b0ec0c4ce887397f161c7e8c21',ramdisk_id='',reservation_id='r-ot41eewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1239780022',owner_user_name='tempest-TestMinimumBasicScenario-1239780022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:11:09Z,user_data=None,user_id='c2322f71af2a478291bfb9d34046394c',uuid=05d57dd8-f51c-4709-a8b9-2f4aeb3039ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converting VIF {"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'pci_devices' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:11:11 user nova-compute[71507]:   <uuid>05d57dd8-f51c-4709-a8b9-2f4aeb3039ff</uuid>
Apr 13 15:11:11 user nova-compute[71507]:   <name>instance-00000010</name>
Apr 13 15:11:11 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:11:11 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:11:11 user nova-compute[71507]:   <metadata>
Apr 13 15:11:11 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:11:11 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:11:11 user nova-compute[71507]:       <nova:name>tempest-TestMinimumBasicScenario-server-377290664</nova:name>
Apr 13 15:11:11 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:11:11</nova:creationTime>
Apr 13 15:11:11 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:11:11 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:11:11 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:11:11 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:11:11 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:11:11 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:11:11 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:11:11 user nova-compute[71507]:       <nova:owner>
Apr 13 15:11:11 user nova-compute[71507]:         <nova:user uuid="c2322f71af2a478291bfb9d34046394c">tempest-TestMinimumBasicScenario-1239780022-project-member</nova:user>
Apr 13 15:11:11 user nova-compute[71507]:         <nova:project uuid="738150b0ec0c4ce887397f161c7e8c21">tempest-TestMinimumBasicScenario-1239780022</nova:project>
Apr 13 15:11:11 user nova-compute[71507]:       </nova:owner>
Apr 13 15:11:11 user nova-compute[71507]:       <nova:root type="image" uuid="be4d330c-57e5-4ce4-afe8-c2b8be481516"/>
Apr 13 15:11:11 user nova-compute[71507]:       <nova:ports>
Apr 13 15:11:11 user nova-compute[71507]:         <nova:port uuid="f7bf7380-3c36-4404-8bba-0f64c3fc59a3">
Apr 13 15:11:11 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 15:11:11 user nova-compute[71507]:         </nova:port>
Apr 13 15:11:11 user nova-compute[71507]:       </nova:ports>
Apr 13 15:11:11 user nova-compute[71507]:     </nova:instance>
Apr 13 15:11:11 user nova-compute[71507]:   </metadata>
Apr 13 15:11:11 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:11:11 user nova-compute[71507]:     <system>
Apr 13 15:11:11 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:11:11 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:11:11 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:11:11 user nova-compute[71507]:       <entry name="serial">05d57dd8-f51c-4709-a8b9-2f4aeb3039ff</entry>
Apr 13 15:11:11 user nova-compute[71507]:       <entry name="uuid">05d57dd8-f51c-4709-a8b9-2f4aeb3039ff</entry>
Apr 13 15:11:11 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:11:11 user nova-compute[71507]:     </system>
Apr 13 15:11:11 user nova-compute[71507]:   </sysinfo>
Apr 13 15:11:11 user nova-compute[71507]:   <os>
Apr 13 15:11:11 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:11:11 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:11:11 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:11:11 user nova-compute[71507]:   </os>
Apr 13 15:11:11 user nova-compute[71507]:   <features>
Apr 13 15:11:11 user nova-compute[71507]:     <acpi/>
Apr 13 15:11:11 user nova-compute[71507]:     <apic/>
Apr 13 15:11:11 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:11:11 user nova-compute[71507]:   </features>
Apr 13 15:11:11 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:11:11 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:11:11 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:11:11 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:11:11 user nova-compute[71507]:   </clock>
Apr 13 15:11:11 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:11:11 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:11:11 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:11:11 user nova-compute[71507]:   </cpu>
Apr 13 15:11:11 user nova-compute[71507]:   <devices>
Apr 13 15:11:11 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:11:11 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:11:11 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk"/>
Apr 13 15:11:11 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:11:11 user nova-compute[71507]:     </disk>
Apr 13 15:11:11 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:11:11 user nova-compute[71507]:       <mac address="fa:16:3e:1f:ca:2e"/>
Apr 13 15:11:11 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:11:11 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:11:11 user nova-compute[71507]:       <target dev="tapf7bf7380-3c"/>
Apr 13 15:11:11 user nova-compute[71507]:     </interface>
Apr 13 15:11:11 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:11:11 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/console.log" append="off"/>
Apr 13 15:11:11 user nova-compute[71507]:     </serial>
Apr 13 15:11:11 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:11:11 user nova-compute[71507]:     <video>
Apr 13 15:11:11 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:11:11 user nova-compute[71507]:     </video>
Apr 13 15:11:11 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:11:11 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:11:11 user nova-compute[71507]:     </rng>
Apr 13 15:11:11 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:11:11 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:11:11 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:11:11 user nova-compute[71507]:     </memballoon>
Apr 13 15:11:11 user nova-compute[71507]:   </devices>
Apr 13 15:11:11 user nova-compute[71507]: </domain>
Apr 13 15:11:11 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-377290664',display_name='tempest-TestMinimumBasicScenario-server-377290664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-377290664',id=16,image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2KhvSB5J03IhhEg5JA/tj1cG2BDSPmL+5jFj0Unl3L4uq4s1XIJI5/ab1Vik7nfl+6oJRIw2tTNA1sr/iUc9YAfC+JNpGyE3k2x1hnrhzYW5YHXhMGc7caYhQEORU1KQ==',key_name='tempest-TestMinimumBasicScenario-1980539872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='738150b0ec0c4ce887397f161c7e8c21',ramdisk_id='',reservation_id='r-ot41eewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1239780022',owner_user_name='tempest-TestMinimumBasicScenario-1239780022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:11:09Z,user_data=None,user_id='c2322f71af2a478291bfb9d34046394c',uuid=05d57dd8-f51c-4709-a8b9-2f4aeb3039ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converting VIF {"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG os_vif [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7bf7380-3c, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7bf7380-3c, col_values=(('external_ids', {'iface-id': 'f7bf7380-3c36-4404-8bba-0f64c3fc59a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:ca:2e', 'vm-uuid': '05d57dd8-f51c-4709-a8b9-2f4aeb3039ff'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:11 user nova-compute[71507]: INFO os_vif [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c')
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No VIF found with MAC fa:16:3e:1f:ca:2e, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updated VIF entry in instance network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updating instance_info_cache with network_info: [{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:11:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b86e082d-1a9f-4695-961a-0b303f884c3a req-b50c14b6-45e9-4d4b-b54d-861a18f8aabb service nova] Releasing lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:11:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] No waiting events found dispatching network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:13 user nova-compute[71507]: WARNING nova.compute.manager [req-2b1d0ea6-608a-4d86-baf2-7d63ccd88ca3 req-84f84522-461b-4c88-bba2-c194c8aea53d service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received unexpected event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance with vm_state building and task_state spawning.
Apr 13 15:11:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] No waiting events found dispatching network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:15 user nova-compute[71507]: WARNING nova.compute.manager [req-084873fb-148c-44be-ab13-a32aa2ada2f3 req-28aa2689-a12b-470b-bf62-bc87e76a2264 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received unexpected event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance with vm_state building and task_state spawning.
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398675.3616996, 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:15 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] VM Resumed (Lifecycle Event)
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:11:15 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Instance spawned successfully.
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:15 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398675.3628507, 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:15 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] VM Started (Lifecycle Event)
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:11:15 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:11:15 user nova-compute[71507]: INFO nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Took 6.32 seconds to spawn the instance on the hypervisor.
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:11:15 user nova-compute[71507]: INFO nova.compute.manager [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Took 7.27 seconds to build instance.
Apr 13 15:11:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-639cb85f-4f58-4c00-81a6-c294cad85e3e tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.369s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:11:15 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:11:16 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updating instance_info_cache with network_info: [{"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:11:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:11:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:11:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:17 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:11:18 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:18 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:11:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:22 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:11:22 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7702MB free_disk=26.3118896484375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 654608ee-5897-429a-b19c-6845d4e84818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1c9a3524-caeb-4333-ae2b-1080115026fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance bfc41492-c482-4a9f-8a5b-9d7520dea39a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398667.8910627, 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:22 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] VM Stopped (Lifecycle Event)
Apr 13 15:11:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-12a3c9f8-beaf-4d12-87f0-3f54f88d5a60 None None] [instance: 95e126d3-bd2c-4cf6-9e9c-fa0b8c80f4bc] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:11:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:24 user nova-compute[71507]: DEBUG nova.objects.instance [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'flavor' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:25 user nova-compute[71507]: INFO nova.compute.manager [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Attaching volume 5579543e-1e86-4db2-b6b5-4a2ff31d59b1 to /dev/vdb
Apr 13 15:11:25 user nova-compute[71507]: DEBUG os_brick.utils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7de64a-ba75-45f9-98bb-c8eda71715de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cd4ad0-9586-47df-9370-47b9b2e8d61e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47c01d2-7e76-4521-a70a-383dbb22f081]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[28110298-ad90-448a-9fd4-495bd961c9d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:11:25 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30e370f-a5d4-4fdd-b9d5-31378e2de16c]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG os_brick.utils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating existing volume attachment record: 6beb0f4c-91f1-4e23-b8bf-7d1279dd2e70 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:25 user nova-compute[71507]: INFO nova.compute.manager [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Terminating instance
Apr 13 15:11:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received event network-vif-unplugged-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] No waiting events found dispatching network-vif-unplugged-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-1623106c-2626-49d2-93f7-34486bbc2388 req-0f063e6f-0d63-45ed-9fa7-89aa4b8dc78d service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received event network-vif-unplugged-49eab8a0-3140-4872-b606-e03f2a243e2f for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Instance destroyed successfully.
Apr 13 15:11:26 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lazy-loading 'resources' on Instance uuid 193136fc-e6c3-4e70-b7ab-01ced440c6bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-955792819',display_name='tempest-TestVolumeSwap-server-955792819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-955792819',id=9,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxaPFHAbqgKO/COFA+DY9rzW2J06VevHnbo6RHC30lfgxcW4Tr0/A0vkvfKOugPt7bpUnVxbSJNj1OF4CitPIV1KK3jFhN1Gew1EBCLK64eY9o49B6MR8/BFPl6+1JP9Q==',key_name='tempest-keypair-207135700',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27787b48c024464091785f8308d8733e',ramdisk_id='',reservation_id='r-rm4mlg63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-927377931',owner_user_name='tempest-TestVolumeSwap-927377931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2141a10d4f543fdaab261486c7e7221',uuid=193136fc-e6c3-4e70-b7ab-01ced440c6bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Converting VIF {"id": "49eab8a0-3140-4872-b606-e03f2a243e2f", "address": "fa:16:3e:6e:39:0d", "network": {"id": "e30a4e6a-48e9-4a29-9721-5a01fc24588e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1996889759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27787b48c024464091785f8308d8733e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49eab8a0-31", "ovs_interfaceid": "49eab8a0-3140-4872-b606-e03f2a243e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:39:0d,bridge_name='br-int',has_traffic_filtering=True,id=49eab8a0-3140-4872-b606-e03f2a243e2f,network=Network(e30a4e6a-48e9-4a29-9721-5a01fc24588e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49eab8a0-31') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG os_vif [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:39:0d,bridge_name='br-int',has_traffic_filtering=True,id=49eab8a0-3140-4872-b606-e03f2a243e2f,network=Network(e30a4e6a-48e9-4a29-9721-5a01fc24588e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49eab8a0-31') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49eab8a0-31, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:11:26 user nova-compute[71507]: INFO os_vif [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:39:0d,bridge_name='br-int',has_traffic_filtering=True,id=49eab8a0-3140-4872-b606-e03f2a243e2f,network=Network(e30a4e6a-48e9-4a29-9721-5a01fc24588e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49eab8a0-31')
Apr 13 15:11:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Deleting instance files /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd_del
Apr 13 15:11:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Deletion of /opt/stack/data/nova/instances/193136fc-e6c3-4e70-b7ab-01ced440c6bd_del complete
Apr 13 15:11:26 user nova-compute[71507]: INFO nova.compute.manager [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 15:11:26 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:11:26 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:11:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:27 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:11:27 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Took 0.78 seconds to deallocate network for instance.
Apr 13 15:11:27 user nova-compute[71507]: DEBUG nova.compute.manager [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received event network-vif-deleted-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:27 user nova-compute[71507]: INFO nova.compute.manager [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Neutron deleted interface 49eab8a0-3140-4872-b606-e03f2a243e2f; detaching it from the instance and deleting it from the info cache
Apr 13 15:11:27 user nova-compute[71507]: DEBUG nova.network.neutron [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:11:27 user nova-compute[71507]: DEBUG nova.compute.manager [req-1c7e1e7d-5afc-4fae-aaad-9d1da281d2d5 req-a6763da2-7e63-4ab1-81f3-cf5eb1b14e4b service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Detach interface failed, port_id=49eab8a0-3140-4872-b606-e03f2a243e2f, reason: Instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:11:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:28 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:11:28 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:11:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:28 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Deleted allocations for instance 193136fc-e6c3-4e70-b7ab-01ced440c6bd
Apr 13 15:11:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7c197-a40e-45a4-8c03-3f391bae861e tempest-TestVolumeSwap-927377931 tempest-TestVolumeSwap-927377931-project-member] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received event network-vif-plugged-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] Acquiring lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] Lock "193136fc-e6c3-4e70-b7ab-01ced440c6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] No waiting events found dispatching network-vif-plugged-49eab8a0-3140-4872-b606-e03f2a243e2f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:28 user nova-compute[71507]: WARNING nova.compute.manager [req-48dc8846-e93a-4009-b196-5f45cfe6c84b req-261d26ec-d8aa-48db-99e0-a4fd67d96611 service nova] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Received unexpected event network-vif-plugged-49eab8a0-3140-4872-b606-e03f2a243e2f for instance with vm_state deleted and task_state None.
Apr 13 15:11:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaBRmrGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:11:29 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:11:29 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:11:29 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a4849-acfd-4a12-bbe1-ca1d4f186470]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:11:29 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1238e4e-4c2b-40ac-a272-e30acb4fd005]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1] added
Apr 13 15:11:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d9ddb2-663f-4d42-9288-d14b4e5b0026]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e359a2b-a9c3-4428-b8c8-714d9f2076ca]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaBRmrGK {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaBRmrGK" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6989b6d0-e3eb-47ce-8d8f-f15265d1c3db]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zaBRmrGK'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.080s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d03e3b9-5365-4bec-bc95-e57f0f17104d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50231ec-bb7b-4a15-a0b3-18d8eb1d0eae]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:11:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:11:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:11:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a75319-51d3-45b3-86b6-7f00e915a6e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1, portal: 172.16.0.220,3260]
Apr 13 15:11:30 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1, portal: 172.16.0.220,3260] successful.
Apr 13 15:11:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c0a1d9-8501-4766-b756-aba4f0d21eea]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d790cb-04a1-405a-adbf-6e84d8068fc6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:11:30 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:11:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:11:30 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:11:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff4df9e-263a-426f-b9f4-e94b40b100a3]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:11:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaBRmrGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23934323531306230', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934323531306230', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG nova.objects.instance [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'flavor' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:11:31 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:11:31 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:11:31 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:11:31 user nova-compute[71507]:   <serial>5579543e-1e86-4db2-b6b5-4a2ff31d59b1</serial>
Apr 13 15:11:31 user nova-compute[71507]: </disk>
Apr 13 15:11:31 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] No VIF found with MAC fa:16:3e:2a:ca:62, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4e06bc30-64a2-425e-a997-0446abfcfd5b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.701s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:33 user nova-compute[71507]: INFO nova.compute.manager [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Rescuing
Apr 13 15:11:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:11:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquired lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:11:33 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:11:33 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating instance_info_cache with network_info: [{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:11:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Releasing lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:11:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:34 user nova-compute[71507]: WARNING nova.compute.manager [req-93b0bd28-d534-437d-a165-8cae822282a9 req-411d8562-2f69-4b49-a204-12f735e67a42 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state rescuing.
Apr 13 15:11:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Instance destroyed successfully.
Apr 13 15:11:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Attempting a stable device rescue
Apr 13 15:11:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Instance directory exists: not creating {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 15:11:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Creating image(s)
Apr 13 15:11:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'trusted_certs' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "ee397e8e00ac6cd514b7cb93644ed8a18e308947" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "ee397e8e00ac6cd514b7cb93644ed8a18e308947" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947.part --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:35 user nova-compute[71507]: DEBUG nova.virt.images [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] b09d887d-e4fc-48c4-a1b4-8c026c0de9fc was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:11:35 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:11:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947.part /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947.part /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947.converted" returned: 0 in 0.331s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947.converted --force-share --output=json" returned: 0 in 0.129s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "ee397e8e00ac6cd514b7cb93644ed8a18e308947" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.568s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "ee397e8e00ac6cd514b7cb93644ed8a18e308947" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "ee397e8e00ac6cd514b7cb93644ed8a18e308947" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:36 user nova-compute[71507]: WARNING nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state rescuing.
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:36 user nova-compute[71507]: WARNING nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state rescuing.
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:36 user nova-compute[71507]: WARNING nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state rescuing.
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:36 user nova-compute[71507]: WARNING nova.compute.manager [req-623ef1ee-619b-4178-95fd-8032db183574 req-c9a0b45c-20fd-4d02-9457-3a36ce501f48 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state rescuing.
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947 --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947,backing_fmt=raw /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947,backing_fmt=raw /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue" returned: 0 in 0.057s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "ee397e8e00ac6cd514b7cb93644ed8a18e308947" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'migration_context' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Start _get_guest_xml network_info=[{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "vif_mac": "fa:16:3e:2a:ca:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b09d887d-e4fc-48c4-a1b4-8c026c0de9fc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaBRmrGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '654608ee-5897-429a-b19c-6845d4e84818', 'attached_at': '', 'detached_at': '', 'volume_id': '5579543e-1e86-4db2-b6b5-4a2ff31d59b1', 'serial': '5579543e-1e86-4db2-b6b5-4a2ff31d59b1'}, 'attachment_id': '6beb0f4c-91f1-4e23-b8bf-7d1279dd2e70', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'resources' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'numa_topology' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:11:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'vcpu_model' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaBRmrGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:11:36 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:11:36 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:11:36 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29348da-e883-4ce9-837e-9e19b53a4f1b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zaBRmrGK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 15:11:36 user nova-compute[71507]: node.name = iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1
Apr 13 15:11:36 user nova-compute[71507]: node.tpgt = -1
Apr 13 15:11:36 user nova-compute[71507]: node.startup = automatic
Apr 13 15:11:36 user nova-compute[71507]: node.leading_login = No
Apr 13 15:11:36 user nova-compute[71507]: iface.iscsi_ifacename = default
Apr 13 15:11:36 user nova-compute[71507]: iface.net_ifacename = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.ipaddress = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.prefix_len = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.hwaddress = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.transport_name = tcp
Apr 13 15:11:36 user nova-compute[71507]: iface.initiatorname = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.state = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.vlan_id = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.vlan_priority = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.vlan_state = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.iface_num = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.mtu = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.port = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.bootproto = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.subnet_mask = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.gateway = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.dhcp_alt_client_id = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.dhcp_dns = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.dhcp_learn_iqn = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.dhcp_vendor_id_state = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.dhcp_vendor_id = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.dhcp_slp_da = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.fragmentation = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.gratuitous_arp = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.incoming_forwarding = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.tos_state = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.tos = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.ttl = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.delayed_ack = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.tcp_nagle = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.tcp_wsf_state = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.tcp_wsf = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.tcp_timer_scale = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.tcp_timestamp = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.redirect = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.def_task_mgmt_timeout = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.header_digest = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.data_digest = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.immediate_data = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.initial_r2t = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.data_seq_inorder = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.data_pdu_inorder = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.erl = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.max_receive_data_len = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.first_burst_len = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.max_outstanding_r2t = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.max_burst_len = 0
Apr 13 15:11:36 user nova-compute[71507]: iface.chap_auth = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.bidi_chap = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.strict_login_compliance = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.discovery_auth = <empty>
Apr 13 15:11:36 user nova-compute[71507]: iface.discovery_logout = <empty>
Apr 13 15:11:36 user nova-compute[71507]: node.discovery_address = <empty>
Apr 13 15:11:36 user nova-compute[71507]: node.discovery_port = 0
Apr 13 15:11:36 user nova-compute[71507]: node.discovery_type = static
Apr 13 15:11:36 user nova-compute[71507]: node.session.initial_cmdsn = 0
Apr 13 15:11:36 user nova-compute[71507]: node.session.initial_login_retry_max = 8
Apr 13 15:11:36 user nova-compute[71507]: node.session.xmit_thread_priority = -20
Apr 13 15:11:36 user nova-compute[71507]: node.session.cmds_max = 128
Apr 13 15:11:36 user nova-compute[71507]: node.session.queue_depth = 32
Apr 13 15:11:36 user nova-compute[71507]: node.session.nr_sessions = 1
Apr 13 15:11:36 user nova-compute[71507]: node.session.auth.authmethod = CHAP
Apr 13 15:11:36 user nova-compute[71507]: node.session.auth.username = zaBRmrGK
Apr 13 15:11:36 user nova-compute[71507]: node.session.auth.password = ***
Apr 13 15:11:36 user nova-compute[71507]: node.session.auth.username_in = <empty>
Apr 13 15:11:36 user nova-compute[71507]: node.session.auth.password_in = <empty>
Apr 13 15:11:36 user nova-compute[71507]: node.session.auth.chap_algs = MD5
Apr 13 15:11:36 user nova-compute[71507]: node.session.timeo.replacement_timeout = 120
Apr 13 15:11:36 user nova-compute[71507]: node.session.err_timeo.abort_timeout = 15
Apr 13 15:11:36 user nova-compute[71507]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 15:11:36 user nova-compute[71507]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 15:11:36 user nova-compute[71507]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.FastAbort = Yes
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.InitialR2T = No
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.ImmediateData = Yes
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.MaxConnections = 1
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 15:11:36 user nova-compute[71507]: node.session.iscsi.ERL = 0
Apr 13 15:11:36 user nova-compute[71507]: node.session.scan = manual
Apr 13 15:11:36 user nova-compute[71507]: node.session.reopen_max = 0
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].address = 172.16.0.220
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].port = 3260
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].startup = manual
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].tcp.window_size = 524288
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].tcp.type_of_service = 0
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].timeo.logout_timeout = 15
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].timeo.login_timeout = 15
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].timeo.auth_timeout = 45
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].iscsi.DataDigest = None
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].iscsi.IFMarker = No
Apr 13 15:11:36 user nova-compute[71507]: node.conn[0].iscsi.OFMarker = No
Apr 13 15:11:36 user nova-compute[71507]: # END RECORD
Apr 13 15:11:36 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eff1ac-c137-4d79-9b36-3e1dd586872c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2da0e0-bcf8-4d49-af41-1ae68b37ba78]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaBRmrGK {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaBRmrGK" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5a7922-cb9a-41a3-91ca-788c44ed8ce1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zaBRmrGK'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[843ea932-b0f7-4979-8c53-de05bfee28fb]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4a576d-9652-45e8-bc98-e26bbdc5b24c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:11:36 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:11:36 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:11:36 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:11:36 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.138s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] HCTL ('34', '0', '0', 0) found on session 14 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[490efabd-d417-410d-b80f-513d6ab30312]: (4, ('0 0 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Searching for a device in session 14 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaBRmrGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.163s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '23934323531306230', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934323531306230', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1909171132',display_name='tempest-ServerStableDeviceRescueTest-server-1909171132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1909171132',id=5,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6aSZKMD7DZRWnRyQAYKNVncY9MliP5yy+hr0mgok5IZOsUvvcpOVyIYwqoPxDEzOUN1HvhtDQMVs5WOR8xHMOt96WLfesTfqwvy1g4TGHpkWUPIHKMkqgOoitvtlLAkg==',key_name='tempest-keypair-135051856',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5acb52755c74d118d012e38feed7237',ramdisk_id='',reservation_id='r-il3m75mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-147407416',owner_user_name='tempest-ServerStableDeviceRescueTest-147407416-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b30a69b780664742aed58bd9a578e873',uuid=654608ee-5897-429a-b19c-6845d4e84818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "vif_mac": "fa:16:3e:2a:ca:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Converting VIF {"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "vif_mac": "fa:16:3e:2a:ca:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:ca:62,bridge_name='br-int',has_traffic_filtering=True,id=a534f901-d679-4443-bf28-aaba09bf631f,network=Network(1cdb762d-7c09-4d16-bd83-31a75edb8a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa534f901-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'pci_devices' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:11:36 user nova-compute[71507]:   <uuid>654608ee-5897-429a-b19c-6845d4e84818</uuid>
Apr 13 15:11:36 user nova-compute[71507]:   <name>instance-00000005</name>
Apr 13 15:11:36 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:11:36 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:11:36 user nova-compute[71507]:   <metadata>
Apr 13 15:11:36 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:11:36 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:11:36 user nova-compute[71507]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1909171132</nova:name>
Apr 13 15:11:36 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:11:36</nova:creationTime>
Apr 13 15:11:36 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:11:36 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:11:36 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:11:36 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:11:36 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:11:36 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:11:36 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:11:36 user nova-compute[71507]:       <nova:owner>
Apr 13 15:11:36 user nova-compute[71507]:         <nova:user uuid="b30a69b780664742aed58bd9a578e873">tempest-ServerStableDeviceRescueTest-147407416-project-member</nova:user>
Apr 13 15:11:36 user nova-compute[71507]:         <nova:project uuid="b5acb52755c74d118d012e38feed7237">tempest-ServerStableDeviceRescueTest-147407416</nova:project>
Apr 13 15:11:36 user nova-compute[71507]:       </nova:owner>
Apr 13 15:11:36 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:11:36 user nova-compute[71507]:       <nova:ports>
Apr 13 15:11:36 user nova-compute[71507]:         <nova:port uuid="a534f901-d679-4443-bf28-aaba09bf631f">
Apr 13 15:11:36 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 15:11:36 user nova-compute[71507]:         </nova:port>
Apr 13 15:11:36 user nova-compute[71507]:       </nova:ports>
Apr 13 15:11:36 user nova-compute[71507]:     </nova:instance>
Apr 13 15:11:36 user nova-compute[71507]:   </metadata>
Apr 13 15:11:36 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:11:36 user nova-compute[71507]:     <system>
Apr 13 15:11:36 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:11:36 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:11:36 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:11:36 user nova-compute[71507]:       <entry name="serial">654608ee-5897-429a-b19c-6845d4e84818</entry>
Apr 13 15:11:36 user nova-compute[71507]:       <entry name="uuid">654608ee-5897-429a-b19c-6845d4e84818</entry>
Apr 13 15:11:36 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:11:36 user nova-compute[71507]:     </system>
Apr 13 15:11:36 user nova-compute[71507]:   </sysinfo>
Apr 13 15:11:36 user nova-compute[71507]:   <os>
Apr 13 15:11:36 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:11:36 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:11:36 user nova-compute[71507]:   </os>
Apr 13 15:11:36 user nova-compute[71507]:   <features>
Apr 13 15:11:36 user nova-compute[71507]:     <acpi/>
Apr 13 15:11:36 user nova-compute[71507]:     <apic/>
Apr 13 15:11:36 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:11:36 user nova-compute[71507]:   </features>
Apr 13 15:11:36 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:11:36 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:11:36 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:11:36 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:11:36 user nova-compute[71507]:   </clock>
Apr 13 15:11:36 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:11:36 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:11:36 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:11:36 user nova-compute[71507]:   </cpu>
Apr 13 15:11:36 user nova-compute[71507]:   <devices>
Apr 13 15:11:36 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:11:36 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:11:36 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk"/>
Apr 13 15:11:36 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:11:36 user nova-compute[71507]:     </disk>
Apr 13 15:11:36 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:11:36 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:11:36 user nova-compute[71507]:       <source dev="/dev/sdc"/>
Apr 13 15:11:36 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:11:36 user nova-compute[71507]:       <serial>5579543e-1e86-4db2-b6b5-4a2ff31d59b1</serial>
Apr 13 15:11:36 user nova-compute[71507]:     </disk>
Apr 13 15:11:36 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:11:36 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:11:36 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue"/>
Apr 13 15:11:36 user nova-compute[71507]:       <target dev="vdc" bus="virtio"/>
Apr 13 15:11:36 user nova-compute[71507]:       <boot order="1"/>
Apr 13 15:11:36 user nova-compute[71507]:     </disk>
Apr 13 15:11:36 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:11:36 user nova-compute[71507]:       <mac address="fa:16:3e:2a:ca:62"/>
Apr 13 15:11:36 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:11:36 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:11:36 user nova-compute[71507]:       <target dev="tapa534f901-d6"/>
Apr 13 15:11:36 user nova-compute[71507]:     </interface>
Apr 13 15:11:36 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:11:36 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/console.log" append="off"/>
Apr 13 15:11:36 user nova-compute[71507]:     </serial>
Apr 13 15:11:36 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:11:36 user nova-compute[71507]:     <video>
Apr 13 15:11:36 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:11:36 user nova-compute[71507]:     </video>
Apr 13 15:11:36 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:11:36 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:11:36 user nova-compute[71507]:     </rng>
Apr 13 15:11:36 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:11:36 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:11:36 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:11:36 user nova-compute[71507]:     </memballoon>
Apr 13 15:11:36 user nova-compute[71507]:   </devices>
Apr 13 15:11:36 user nova-compute[71507]: </domain>
Apr 13 15:11:36 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:11:36 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Instance destroyed successfully.
Apr 13 15:11:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:11:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] No VIF found with MAC fa:16:3e:2a:ca:62, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:11:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:38 user nova-compute[71507]: WARNING nova.compute.manager [req-cf5b8d16-c03e-4ec7-91d7-ac5e2294ade5 req-0d448b5c-a0b8-4483-8ca5-911e991b2583 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state rescuing.
Apr 13 15:11:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:40 user nova-compute[71507]: WARNING nova.compute.manager [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state rescuing.
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:40 user nova-compute[71507]: WARNING nova.compute.manager [req-e61a3cfb-65b1-49a5-9db1-b67a2b301c84 req-e994acaa-c294-49f4-85e9-57d7d547ed97 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state rescuing.
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for 654608ee-5897-429a-b19c-6845d4e84818 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398700.5965862, 654608ee-5897-429a-b19c-6845d4e84818 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:40 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] VM Resumed (Lifecycle Event)
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fa9b1b41-7fba-4f80-8f15-9b16e8faf34b tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:11:40 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398700.5981147, 654608ee-5897-429a-b19c-6845d4e84818 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:40 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] VM Started (Lifecycle Event)
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:11:41 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398686.744564, 193136fc-e6c3-4e70-b7ab-01ced440c6bd => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:41 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] VM Stopped (Lifecycle Event)
Apr 13 15:11:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7d7e94e2-9da8-4078-b654-5d4c6cd23ae8 None None] [instance: 193136fc-e6c3-4e70-b7ab-01ced440c6bd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:11:42 user nova-compute[71507]: INFO nova.compute.claims [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Claim successful on node user
Apr 13 15:11:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.network.neutron [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:11:42 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.policy [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:11:42 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Creating image(s)
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk 1073741824" returned: 0 in 0.047s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Cannot resize image /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG nova.objects.instance [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'migration_context' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Ensure instance console log exists: /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:43 user nova-compute[71507]: DEBUG nova.network.neutron [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Successfully created port: 9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:11:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Successfully updated port: 9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:11:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:11:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:11:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:11:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-changed-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Refreshing instance network info cache due to event network-changed-9c8ad360-aa62-4ef1-952f-d73f885baa89. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:11:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] Acquiring lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:11:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:11:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance_info_cache with network_info: [{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance network_info: |[{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] Acquired lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.network.neutron [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Refreshing network info cache for port 9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Start _get_guest_xml network_info=[{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:11:45 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:11:45 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-1163510400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.objects.instance [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'pci_devices' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:11:45 user nova-compute[71507]:   <uuid>ccc7b5bd-5f78-448e-bd82-74b2263dff75</uuid>
Apr 13 15:11:45 user nova-compute[71507]:   <name>instance-00000011</name>
Apr 13 15:11:45 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:11:45 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:11:45 user nova-compute[71507]:   <metadata>
Apr 13 15:11:45 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:11:45 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:11:45 user nova-compute[71507]:       <nova:name>tempest-ServerActionsTestJSON-server-1163510400</nova:name>
Apr 13 15:11:45 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:11:45</nova:creationTime>
Apr 13 15:11:45 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:11:45 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:11:45 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:11:45 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:11:45 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:11:45 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:11:45 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:11:45 user nova-compute[71507]:       <nova:owner>
Apr 13 15:11:45 user nova-compute[71507]:         <nova:user uuid="3c12c62d4137473596571e523163e718">tempest-ServerActionsTestJSON-423674903-project-member</nova:user>
Apr 13 15:11:45 user nova-compute[71507]:         <nova:project uuid="9154e4239a1a42a3820c27563ba0513f">tempest-ServerActionsTestJSON-423674903</nova:project>
Apr 13 15:11:45 user nova-compute[71507]:       </nova:owner>
Apr 13 15:11:45 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:11:45 user nova-compute[71507]:       <nova:ports>
Apr 13 15:11:45 user nova-compute[71507]:         <nova:port uuid="9c8ad360-aa62-4ef1-952f-d73f885baa89">
Apr 13 15:11:45 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 15:11:45 user nova-compute[71507]:         </nova:port>
Apr 13 15:11:45 user nova-compute[71507]:       </nova:ports>
Apr 13 15:11:45 user nova-compute[71507]:     </nova:instance>
Apr 13 15:11:45 user nova-compute[71507]:   </metadata>
Apr 13 15:11:45 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:11:45 user nova-compute[71507]:     <system>
Apr 13 15:11:45 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:11:45 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:11:45 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:11:45 user nova-compute[71507]:       <entry name="serial">ccc7b5bd-5f78-448e-bd82-74b2263dff75</entry>
Apr 13 15:11:45 user nova-compute[71507]:       <entry name="uuid">ccc7b5bd-5f78-448e-bd82-74b2263dff75</entry>
Apr 13 15:11:45 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:11:45 user nova-compute[71507]:     </system>
Apr 13 15:11:45 user nova-compute[71507]:   </sysinfo>
Apr 13 15:11:45 user nova-compute[71507]:   <os>
Apr 13 15:11:45 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:11:45 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:11:45 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:11:45 user nova-compute[71507]:   </os>
Apr 13 15:11:45 user nova-compute[71507]:   <features>
Apr 13 15:11:45 user nova-compute[71507]:     <acpi/>
Apr 13 15:11:45 user nova-compute[71507]:     <apic/>
Apr 13 15:11:45 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:11:45 user nova-compute[71507]:   </features>
Apr 13 15:11:45 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:11:45 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:11:45 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:11:45 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:11:45 user nova-compute[71507]:   </clock>
Apr 13 15:11:45 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:11:45 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:11:45 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:11:45 user nova-compute[71507]:   </cpu>
Apr 13 15:11:45 user nova-compute[71507]:   <devices>
Apr 13 15:11:45 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:11:45 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:11:45 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk"/>
Apr 13 15:11:45 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:11:45 user nova-compute[71507]:     </disk>
Apr 13 15:11:45 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:11:45 user nova-compute[71507]:       <mac address="fa:16:3e:f7:02:ec"/>
Apr 13 15:11:45 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:11:45 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:11:45 user nova-compute[71507]:       <target dev="tap9c8ad360-aa"/>
Apr 13 15:11:45 user nova-compute[71507]:     </interface>
Apr 13 15:11:45 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:11:45 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/console.log" append="off"/>
Apr 13 15:11:45 user nova-compute[71507]:     </serial>
Apr 13 15:11:45 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:11:45 user nova-compute[71507]:     <video>
Apr 13 15:11:45 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:11:45 user nova-compute[71507]:     </video>
Apr 13 15:11:45 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:11:45 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:11:45 user nova-compute[71507]:     </rng>
Apr 13 15:11:45 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:11:45 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:11:45 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:11:45 user nova-compute[71507]:     </memballoon>
Apr 13 15:11:45 user nova-compute[71507]:   </devices>
Apr 13 15:11:45 user nova-compute[71507]: </domain>
Apr 13 15:11:45 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-1163510400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG os_vif [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c8ad360-aa, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c8ad360-aa, col_values=(('external_ids', {'iface-id': '9c8ad360-aa62-4ef1-952f-d73f885baa89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:02:ec', 'vm-uuid': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:45 user nova-compute[71507]: INFO os_vif [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa')
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No VIF found with MAC fa:16:3e:f7:02:ec, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.network.neutron [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updated VIF entry in instance network info cache for port 9c8ad360-aa62-4ef1-952f-d73f885baa89. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG nova.network.neutron [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance_info_cache with network_info: [{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:11:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-405a21f8-bccc-42fd-b751-5e2e79f7d7e3 req-d75d417f-16b5-41b1-bd66-91a9bfd18d8d service nova] Releasing lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:11:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:46 user nova-compute[71507]: WARNING nova.compute.manager [req-6213f172-b650-480c-9c42-880065867251 req-59c5a075-98ec-4e53-8915-a3843535b236 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state building and task_state spawning.
Apr 13 15:11:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398708.8370047, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:48 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] VM Resumed (Lifecycle Event)
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:11:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance spawned successfully.
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:11:48 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398708.8386772, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:11:48 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] VM Started (Lifecycle Event)
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:11:48 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:11:48 user nova-compute[71507]: WARNING nova.compute.manager [req-eab6129c-8982-49f4-b52a-319dfb19de01 req-70593c1a-6f6a-4d80-a270-87b056f49f5a service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state building and task_state spawning.
Apr 13 15:11:49 user nova-compute[71507]: INFO nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Took 6.19 seconds to spawn the instance on the hypervisor.
Apr 13 15:11:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:11:49 user nova-compute[71507]: INFO nova.compute.manager [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Took 6.96 seconds to build instance.
Apr 13 15:11:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-61a4b531-c0f6-49be-a0c6-e66e76224f58 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.052s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:11:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:11:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:12 user nova-compute[71507]: INFO nova.compute.manager [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Rescuing
Apr 13 15:12:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquired lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:12 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:12:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updating instance_info_cache with network_info: [{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Releasing lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:13 user nova-compute[71507]: WARNING nova.compute.manager [req-57e8b881-8efe-4e3a-a100-27b912a3e4b7 req-ae7c56b1-2ec7-4bcf-9efd-2e54bb1e44eb service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state active and task_state rescuing.
Apr 13 15:12:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Instance destroyed successfully.
Apr 13 15:12:13 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Attempting rescue
Apr 13 15:12:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Instance directory exists: not creating {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 15:12:13 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Creating image(s)
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG nova.objects.instance [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'trusted_certs' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:13 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue" returned: 0 in 0.045s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.objects.instance [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'migration_context' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Start _get_guest_xml network_info=[{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "vif_mac": "fa:16:3e:45:ab:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.objects.instance [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'resources' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.objects.instance [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'numa_topology' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:14 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:14 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.objects.instance [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'vcpu_model' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-848115608',display_name='tempest-ServerRescueNegativeTestJSON-server-848115608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-848115608',id=2,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:07:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-q6b0p4z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:07:46Z,user_data=None,user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=f54cffe3-73da-468b-8252-b74cb4ba9653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "vif_mac": "fa:16:3e:45:ab:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "vif_mac": "fa:16:3e:45:ab:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:ab:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d9b23f6-72f8-44b8-bf33-5abc1543e18d,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9b23f6-72') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.objects.instance [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'pci_devices' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:12:14 user nova-compute[71507]:   <uuid>f54cffe3-73da-468b-8252-b74cb4ba9653</uuid>
Apr 13 15:12:14 user nova-compute[71507]:   <name>instance-00000002</name>
Apr 13 15:12:14 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:12:14 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:12:14 user nova-compute[71507]:   <metadata>
Apr 13 15:12:14 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:12:14 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:12:14 user nova-compute[71507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-848115608</nova:name>
Apr 13 15:12:14 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:12:14</nova:creationTime>
Apr 13 15:12:14 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:12:14 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:12:14 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:12:14 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:12:14 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:12:14 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:12:14 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:12:14 user nova-compute[71507]:       <nova:owner>
Apr 13 15:12:14 user nova-compute[71507]:         <nova:user uuid="c83940ddaaf64d94b40df9d00349aa91">tempest-ServerRescueNegativeTestJSON-66620130-project-member</nova:user>
Apr 13 15:12:14 user nova-compute[71507]:         <nova:project uuid="9bad96fcfa0d4691af2a7990ba9dbd09">tempest-ServerRescueNegativeTestJSON-66620130</nova:project>
Apr 13 15:12:14 user nova-compute[71507]:       </nova:owner>
Apr 13 15:12:14 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:12:14 user nova-compute[71507]:       <nova:ports>
Apr 13 15:12:14 user nova-compute[71507]:         <nova:port uuid="0d9b23f6-72f8-44b8-bf33-5abc1543e18d">
Apr 13 15:12:14 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 15:12:14 user nova-compute[71507]:         </nova:port>
Apr 13 15:12:14 user nova-compute[71507]:       </nova:ports>
Apr 13 15:12:14 user nova-compute[71507]:     </nova:instance>
Apr 13 15:12:14 user nova-compute[71507]:   </metadata>
Apr 13 15:12:14 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:12:14 user nova-compute[71507]:     <system>
Apr 13 15:12:14 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:12:14 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:12:14 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:12:14 user nova-compute[71507]:       <entry name="serial">f54cffe3-73da-468b-8252-b74cb4ba9653</entry>
Apr 13 15:12:14 user nova-compute[71507]:       <entry name="uuid">f54cffe3-73da-468b-8252-b74cb4ba9653</entry>
Apr 13 15:12:14 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:12:14 user nova-compute[71507]:     </system>
Apr 13 15:12:14 user nova-compute[71507]:   </sysinfo>
Apr 13 15:12:14 user nova-compute[71507]:   <os>
Apr 13 15:12:14 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:12:14 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:12:14 user nova-compute[71507]:   </os>
Apr 13 15:12:14 user nova-compute[71507]:   <features>
Apr 13 15:12:14 user nova-compute[71507]:     <acpi/>
Apr 13 15:12:14 user nova-compute[71507]:     <apic/>
Apr 13 15:12:14 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:12:14 user nova-compute[71507]:   </features>
Apr 13 15:12:14 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:12:14 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:12:14 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:12:14 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:12:14 user nova-compute[71507]:   </clock>
Apr 13 15:12:14 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:12:14 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:12:14 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:12:14 user nova-compute[71507]:   </cpu>
Apr 13 15:12:14 user nova-compute[71507]:   <devices>
Apr 13 15:12:14 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:12:14 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:12:14 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue"/>
Apr 13 15:12:14 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:12:14 user nova-compute[71507]:     </disk>
Apr 13 15:12:14 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:12:14 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:12:14 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk"/>
Apr 13 15:12:14 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:12:14 user nova-compute[71507]:     </disk>
Apr 13 15:12:14 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:12:14 user nova-compute[71507]:       <mac address="fa:16:3e:45:ab:a1"/>
Apr 13 15:12:14 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:12:14 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:12:14 user nova-compute[71507]:       <target dev="tap0d9b23f6-72"/>
Apr 13 15:12:14 user nova-compute[71507]:     </interface>
Apr 13 15:12:14 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:12:14 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/console.log" append="off"/>
Apr 13 15:12:14 user nova-compute[71507]:     </serial>
Apr 13 15:12:14 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:12:14 user nova-compute[71507]:     <video>
Apr 13 15:12:14 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:12:14 user nova-compute[71507]:     </video>
Apr 13 15:12:14 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:12:14 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:12:14 user nova-compute[71507]:     </rng>
Apr 13 15:12:14 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:12:14 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:12:14 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:12:14 user nova-compute[71507]:     </memballoon>
Apr 13 15:12:14 user nova-compute[71507]:   </devices>
Apr 13 15:12:14 user nova-compute[71507]: </domain>
Apr 13 15:12:14 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:12:14 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Instance destroyed successfully.
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No VIF found with MAC fa:16:3e:45:ab:a1, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:15 user nova-compute[71507]: WARNING nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state active and task_state rescuing.
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:15 user nova-compute[71507]: WARNING nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state active and task_state rescuing.
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:15 user nova-compute[71507]: WARNING nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state active and task_state rescuing.
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:15 user nova-compute[71507]: WARNING nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state active and task_state rescuing.
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:15 user nova-compute[71507]: WARNING nova.compute.manager [req-56242faa-c6eb-4866-adb0-38bf1e7558a2 req-399cb28d-3a96-40d2-849a-d1043763e8c7 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state active and task_state rescuing.
Apr 13 15:12:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:16 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating instance_info_cache with network_info: [{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:17 user nova-compute[71507]: WARNING nova.compute.manager [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state active and task_state rescuing.
Apr 13 15:12:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:17 user nova-compute[71507]: WARNING nova.compute.manager [req-d0b95745-b878-4ddb-93ea-c24a8b37f716 req-25cf8da4-96a9-4e4f-b17d-94136629e9ca service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state active and task_state rescuing.
Apr 13 15:12:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for f54cffe3-73da-468b-8252-b74cb4ba9653 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:12:18 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398737.9999163, f54cffe3-73da-468b-8252-b74cb4ba9653 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:12:18 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] VM Resumed (Lifecycle Event)
Apr 13 15:12:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cfdc1a7e-baf4-4531-9d31-ca7d098ca500 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:12:18 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 15:12:18 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398738.0014284, f54cffe3-73da-468b-8252-b74cb4ba9653 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:12:18 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] VM Started (Lifecycle Event)
Apr 13 15:12:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:12:19 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:12:19 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:12:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:19 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:12:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:24 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:24 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=26.208110809326172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 654608ee-5897-429a-b19c-6845d4e84818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1c9a3524-caeb-4333-ae2b-1080115026fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance bfc41492-c482-4a9f-8a5b-9d7520dea39a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:12:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:25 user nova-compute[71507]: INFO nova.compute.manager [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Rescuing
Apr 13 15:12:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquired lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:25 user nova-compute[71507]: DEBUG nova.network.neutron [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:12:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:25 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:12:25 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:12:25 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:12:25 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:12:25 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG nova.network.neutron [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updating instance_info_cache with network_info: [{"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Releasing lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-unplugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-unplugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:26 user nova-compute[71507]: WARNING nova.compute.manager [req-c08b3683-be7b-464e-9519-d92cf9d19986 req-ed37889e-6fad-4648-a8c0-4398eff36640 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-unplugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state active and task_state rescuing.
Apr 13 15:12:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:27 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Instance destroyed successfully.
Apr 13 15:12:27 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Attempting a stable device rescue
Apr 13 15:12:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 15:12:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Instance directory exists: not creating {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 15:12:27 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Creating image(s)
Apr 13 15:12:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "/opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "/opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:27 user nova-compute[71507]: DEBUG nova.objects.instance [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "397647af823b1939ff5134772f0cd89fd13b8047" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "397647af823b1939ff5134772f0cd89fd13b8047" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047.part --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG nova.virt.images [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] aaed905f-34ee-40a1-9a14-339081983049 was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047.part /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047.part /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047.converted" returned: 0 in 0.482s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:28 user nova-compute[71507]: WARNING nova.compute.manager [req-d8023bb6-3f68-46fa-8d57-17ac3821b586 req-a0bf3fad-3a73-4962-8e60-0ef50553d08a service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state active and task_state rescuing.
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "397647af823b1939ff5134772f0cd89fd13b8047" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.601s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "397647af823b1939ff5134772f0cd89fd13b8047" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "397647af823b1939ff5134772f0cd89fd13b8047" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047 --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047,backing_fmt=raw /opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.rescue {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047,backing_fmt=raw /opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.rescue" returned: 0 in 0.046s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "397647af823b1939ff5134772f0cd89fd13b8047" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'migration_context' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Start _get_guest_xml network_info=[{"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "vif_mac": "fa:16:3e:37:e4:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aaed905f-34ee-40a1-9a14-339081983049', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEauhSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0a0a9548-9e57-4007-bafb-d418a4433473', 'attached_at': '', 'detached_at': '', 'volume_id': '0c479ed5-b804-485c-a64f-90d780d66450', 'serial': '0c479ed5-b804-485c-a64f-90d780d66450'}, 'attachment_id': '74bb6c51-38e0-4465-9e61-aa1625d9dcc8', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'resources' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:29 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:29 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEauhSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:12:29 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:12:29 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:12:29 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2159f3f1-ab38-405d-94eb-693f7edfece2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iEauhSDY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 15:12:29 user nova-compute[71507]: node.name = iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:12:29 user nova-compute[71507]: node.tpgt = -1
Apr 13 15:12:29 user nova-compute[71507]: node.startup = automatic
Apr 13 15:12:29 user nova-compute[71507]: node.leading_login = No
Apr 13 15:12:29 user nova-compute[71507]: iface.iscsi_ifacename = default
Apr 13 15:12:29 user nova-compute[71507]: iface.net_ifacename = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.ipaddress = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.prefix_len = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.hwaddress = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.transport_name = tcp
Apr 13 15:12:29 user nova-compute[71507]: iface.initiatorname = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.state = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.vlan_id = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.vlan_priority = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.vlan_state = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.iface_num = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.mtu = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.port = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.bootproto = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.subnet_mask = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.gateway = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.dhcp_alt_client_id = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.dhcp_dns = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.dhcp_learn_iqn = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.dhcp_vendor_id_state = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.dhcp_vendor_id = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.dhcp_slp_da = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.fragmentation = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.gratuitous_arp = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.incoming_forwarding = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.tos_state = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.tos = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.ttl = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.delayed_ack = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.tcp_nagle = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.tcp_wsf_state = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.tcp_wsf = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.tcp_timer_scale = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.tcp_timestamp = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.redirect = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.def_task_mgmt_timeout = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.header_digest = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.data_digest = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.immediate_data = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.initial_r2t = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.data_seq_inorder = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.data_pdu_inorder = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.erl = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.max_receive_data_len = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.first_burst_len = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.max_outstanding_r2t = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.max_burst_len = 0
Apr 13 15:12:29 user nova-compute[71507]: iface.chap_auth = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.bidi_chap = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.strict_login_compliance = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.discovery_auth = <empty>
Apr 13 15:12:29 user nova-compute[71507]: iface.discovery_logout = <empty>
Apr 13 15:12:29 user nova-compute[71507]: node.discovery_address = <empty>
Apr 13 15:12:29 user nova-compute[71507]: node.discovery_port = 0
Apr 13 15:12:29 user nova-compute[71507]: node.discovery_type = static
Apr 13 15:12:29 user nova-compute[71507]: node.session.initial_cmdsn = 0
Apr 13 15:12:29 user nova-compute[71507]: node.session.initial_login_retry_max = 8
Apr 13 15:12:29 user nova-compute[71507]: node.session.xmit_thread_priority = -20
Apr 13 15:12:29 user nova-compute[71507]: node.session.cmds_max = 128
Apr 13 15:12:29 user nova-compute[71507]: node.session.queue_depth = 32
Apr 13 15:12:29 user nova-compute[71507]: node.session.nr_sessions = 1
Apr 13 15:12:29 user nova-compute[71507]: node.session.auth.authmethod = CHAP
Apr 13 15:12:29 user nova-compute[71507]: node.session.auth.username = iEauhSDY
Apr 13 15:12:29 user nova-compute[71507]: node.session.auth.password = ***
Apr 13 15:12:29 user nova-compute[71507]: node.session.auth.username_in = <empty>
Apr 13 15:12:29 user nova-compute[71507]: node.session.auth.password_in = <empty>
Apr 13 15:12:29 user nova-compute[71507]: node.session.auth.chap_algs = MD5
Apr 13 15:12:29 user nova-compute[71507]: node.session.timeo.replacement_timeout = 120
Apr 13 15:12:29 user nova-compute[71507]: node.session.err_timeo.abort_timeout = 15
Apr 13 15:12:29 user nova-compute[71507]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 15:12:29 user nova-compute[71507]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 15:12:29 user nova-compute[71507]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.FastAbort = Yes
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.InitialR2T = No
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.ImmediateData = Yes
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.MaxConnections = 1
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 15:12:29 user nova-compute[71507]: node.session.iscsi.ERL = 0
Apr 13 15:12:29 user nova-compute[71507]: node.session.scan = manual
Apr 13 15:12:29 user nova-compute[71507]: node.session.reopen_max = 0
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].address = 172.16.0.220
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].port = 3260
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].startup = manual
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].tcp.window_size = 524288
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].tcp.type_of_service = 0
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].timeo.logout_timeout = 15
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].timeo.login_timeout = 15
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].timeo.auth_timeout = 45
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].iscsi.DataDigest = None
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].iscsi.IFMarker = No
Apr 13 15:12:29 user nova-compute[71507]: node.conn[0].iscsi.OFMarker = No
Apr 13 15:12:29 user nova-compute[71507]: # END RECORD
Apr 13 15:12:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc46c71a-4f36-40cf-b717-68a33d42af56]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd81ed1a-58b9-4cf2-a25e-feb062ce37e5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEauhSDY {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEauhSDY" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd63273-b4bd-4d73-bedd-a74dc2d2d201]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iEauhSDY'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa64d88-95ac-4747-8ef8-a3647573bc51]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e566c5-d271-45e3-a060-601840a4396a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:12:29 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:12:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:12:29 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:12:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.199s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e28dbe-3e5c-4098-8c73-81a1b16af1a5]: (4, ('0 0 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEauhSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.225s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] <== connect_volume: return (227ms) {'type': 'block', 'scsi_wwn': '23034313430653834', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034313430653834', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-370949425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-370949425',id=13,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:10:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-khfgpjah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:10:51Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=0a0a9548-9e57-4007-bafb-d418a4433473,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "vif_mac": "fa:16:3e:37:e4:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "vif_mac": "fa:16:3e:37:e4:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=0acacba1-f2ca-42c6-9ccb-bb3606bf706e,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acacba1-f2') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:12:29 user nova-compute[71507]:   <uuid>0a0a9548-9e57-4007-bafb-d418a4433473</uuid>
Apr 13 15:12:29 user nova-compute[71507]:   <name>instance-0000000d</name>
Apr 13 15:12:29 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:12:29 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:12:29 user nova-compute[71507]:   <metadata>
Apr 13 15:12:29 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:12:29 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:12:29 user nova-compute[71507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-370949425</nova:name>
Apr 13 15:12:29 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:12:29</nova:creationTime>
Apr 13 15:12:29 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:12:29 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:12:29 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:12:29 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:12:29 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:12:29 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:12:29 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:12:29 user nova-compute[71507]:       <nova:owner>
Apr 13 15:12:29 user nova-compute[71507]:         <nova:user uuid="75bf6e19993f4c2e90fd52c4d6212622">tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member</nova:user>
Apr 13 15:12:29 user nova-compute[71507]:         <nova:project uuid="240b28f42732478ba732994b2c9e3fbe">tempest-ServerBootFromVolumeStableRescueTest-1009244781</nova:project>
Apr 13 15:12:29 user nova-compute[71507]:       </nova:owner>
Apr 13 15:12:29 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:12:29 user nova-compute[71507]:       <nova:ports>
Apr 13 15:12:29 user nova-compute[71507]:         <nova:port uuid="0acacba1-f2ca-42c6-9ccb-bb3606bf706e">
Apr 13 15:12:29 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 15:12:29 user nova-compute[71507]:         </nova:port>
Apr 13 15:12:29 user nova-compute[71507]:       </nova:ports>
Apr 13 15:12:29 user nova-compute[71507]:     </nova:instance>
Apr 13 15:12:29 user nova-compute[71507]:   </metadata>
Apr 13 15:12:29 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:12:29 user nova-compute[71507]:     <system>
Apr 13 15:12:29 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:12:29 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:12:29 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:12:29 user nova-compute[71507]:       <entry name="serial">0a0a9548-9e57-4007-bafb-d418a4433473</entry>
Apr 13 15:12:29 user nova-compute[71507]:       <entry name="uuid">0a0a9548-9e57-4007-bafb-d418a4433473</entry>
Apr 13 15:12:29 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:12:29 user nova-compute[71507]:     </system>
Apr 13 15:12:29 user nova-compute[71507]:   </sysinfo>
Apr 13 15:12:29 user nova-compute[71507]:   <os>
Apr 13 15:12:29 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:12:29 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:12:29 user nova-compute[71507]:   </os>
Apr 13 15:12:29 user nova-compute[71507]:   <features>
Apr 13 15:12:29 user nova-compute[71507]:     <acpi/>
Apr 13 15:12:29 user nova-compute[71507]:     <apic/>
Apr 13 15:12:29 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:12:29 user nova-compute[71507]:   </features>
Apr 13 15:12:29 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:12:29 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:12:29 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:12:29 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:12:29 user nova-compute[71507]:   </clock>
Apr 13 15:12:29 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:12:29 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:12:29 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:12:29 user nova-compute[71507]:   </cpu>
Apr 13 15:12:29 user nova-compute[71507]:   <devices>
Apr 13 15:12:29 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:12:29 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:12:29 user nova-compute[71507]:       <source dev="/dev/sdb"/>
Apr 13 15:12:29 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:12:29 user nova-compute[71507]:       <serial>0c479ed5-b804-485c-a64f-90d780d66450</serial>
Apr 13 15:12:29 user nova-compute[71507]:     </disk>
Apr 13 15:12:29 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:12:29 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:12:29 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.rescue"/>
Apr 13 15:12:29 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:12:29 user nova-compute[71507]:       <boot order="1"/>
Apr 13 15:12:29 user nova-compute[71507]:     </disk>
Apr 13 15:12:29 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:12:29 user nova-compute[71507]:       <mac address="fa:16:3e:37:e4:e9"/>
Apr 13 15:12:29 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:12:29 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:12:29 user nova-compute[71507]:       <target dev="tap0acacba1-f2"/>
Apr 13 15:12:29 user nova-compute[71507]:     </interface>
Apr 13 15:12:29 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:12:29 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/console.log" append="off"/>
Apr 13 15:12:29 user nova-compute[71507]:     </serial>
Apr 13 15:12:29 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:12:29 user nova-compute[71507]:     <video>
Apr 13 15:12:29 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:12:29 user nova-compute[71507]:     </video>
Apr 13 15:12:29 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:12:29 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:12:29 user nova-compute[71507]:     </rng>
Apr 13 15:12:29 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:12:29 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:12:29 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:12:29 user nova-compute[71507]:     </memballoon>
Apr 13 15:12:29 user nova-compute[71507]:   </devices>
Apr 13 15:12:29 user nova-compute[71507]: </domain>
Apr 13 15:12:29 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:12:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Instance destroyed successfully.
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:12:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No VIF found with MAC fa:16:3e:37:e4:e9, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:12:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:31 user nova-compute[71507]: WARNING nova.compute.manager [req-d2102053-08fc-4fbb-87e4-416dbef5e2e7 req-5cbf27fe-b77f-45a2-a1e0-2f24cbc0bea2 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state active and task_state rescuing.
Apr 13 15:12:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:33 user nova-compute[71507]: WARNING nova.compute.manager [req-10f46d71-d395-49db-a894-ba9761398d31 req-8d36c06b-d19b-471d-9a76-687becc19f1e service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state active and task_state rescuing.
Apr 13 15:12:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for 0a0a9548-9e57-4007-bafb-d418a4433473 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:12:34 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398754.0298302, 0a0a9548-9e57-4007-bafb-d418a4433473 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:12:34 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] VM Resumed (Lifecycle Event)
Apr 13 15:12:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-14b3203a-6d4c-4fa0-9a54-0d580005408a tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:12:34 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 15:12:34 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398754.0374029, 0a0a9548-9e57-4007-bafb-d418a4433473 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:12:34 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] VM Started (Lifecycle Event)
Apr 13 15:12:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:12:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:38 user nova-compute[71507]: INFO nova.compute.manager [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Unshelving
Apr 13 15:12:38 user nova-compute[71507]: INFO nova.virt.block_device [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Booting with volume 0ddca559-4699-4c09-aca9-db61ea2e7961 at /dev/vda
Apr 13 15:12:38 user nova-compute[71507]: DEBUG os_brick.utils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9884e5bc-4289-4496-8d8c-d3e30e8c71e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b9966-f1c0-451d-8d2b-ab98d637b684]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[41483ad8-25d8-449a-ae68-f024a16f9c23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf1369f-d462-4a74-a40c-a884bf1f6bd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:12:38 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:12:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cf2af8-694c-4881-a591-036f561a54dc]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG os_brick.utils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:12:38 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating existing volume attachment record: 705ca9ca-c7c1-4bcc-ae06-c590cc7f0d56 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:12:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "1c9a3524-caeb-4333-ae2b-1080115026fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:41 user nova-compute[71507]: INFO nova.compute.manager [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Terminating instance
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:41 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Instance destroyed successfully.
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.objects.instance [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lazy-loading 'resources' on Instance uuid 1c9a3524-caeb-4333-ae2b-1080115026fd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received event network-vif-unplugged-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] Acquiring lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] No waiting events found dispatching network-vif-unplugged-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-2c45cb26-9e5e-488d-b4b3-50b7902a09b8 req-9a1b1a5b-888e-4fe0-9863-5f8b8080e54b service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received event network-vif-unplugged-575668b5-eb5b-4275-962a-db577c3931a0 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1114961218',display_name='tempest-VolumesActionsTest-instance-1114961218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1114961218',id=14,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:10:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c0cae04ab4b4157a7ef786d165789a6',ramdisk_id='',reservation_id='r-0fd29a81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-119634704',owner_user_name='tempest-VolumesActionsTest-119634704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:10:57Z,user_data=None,user_id='3bdc942f33ca46c08bb143ed2efeb458',uuid=1c9a3524-caeb-4333-ae2b-1080115026fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converting VIF {"id": "575668b5-eb5b-4275-962a-db577c3931a0", "address": "fa:16:3e:78:00:e0", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap575668b5-eb", "ovs_interfaceid": "575668b5-eb5b-4275-962a-db577c3931a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=575668b5-eb5b-4275-962a-db577c3931a0,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575668b5-eb') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG os_vif [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=575668b5-eb5b-4275-962a-db577c3931a0,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575668b5-eb') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap575668b5-eb, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:41 user nova-compute[71507]: INFO os_vif [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=575668b5-eb5b-4275-962a-db577c3931a0,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap575668b5-eb')
Apr 13 15:12:41 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Deleting instance files /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd_del
Apr 13 15:12:41 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Deletion of /opt/stack/data/nova/instances/1c9a3524-caeb-4333-ae2b-1080115026fd_del complete
Apr 13 15:12:41 user nova-compute[71507]: INFO nova.compute.manager [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 13 15:12:41 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:12:41 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:12:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:42 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:42 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Took 0.86 seconds to deallocate network for instance.
Apr 13 15:12:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-e0daaa22-ad61-41ae-89d5-e03dddb0bdf5 req-aa038464-c806-4987-a342-bc5290ec9333 service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received event network-vif-deleted-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:43 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Deleted allocations for instance 1c9a3524-caeb-4333-ae2b-1080115026fd
Apr 13 15:12:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-00dce341-6c34-4933-ba24-c8dcd32367a5 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lazy-loading 'pci_requests' on Instance uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lazy-loading 'numa_topology' on Instance uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:12:43 user nova-compute[71507]: INFO nova.compute.claims [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Claim successful on node user
Apr 13 15:12:43 user nova-compute[71507]: DEBUG nova.compute.manager [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received event network-vif-plugged-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] Acquiring lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] Lock "1c9a3524-caeb-4333-ae2b-1080115026fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG nova.compute.manager [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] No waiting events found dispatching network-vif-plugged-575668b5-eb5b-4275-962a-db577c3931a0 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:43 user nova-compute[71507]: WARNING nova.compute.manager [req-5868c73c-6587-497d-a8b3-fdd01462068f req-9c1deaf3-11ef-479d-8216-2ce35bdece29 service nova] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Received unexpected event network-vif-plugged-575668b5-eb5b-4275-962a-db577c3931a0 for instance with vm_state deleted and task_state None.
Apr 13 15:12:43 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:12:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:44 user nova-compute[71507]: INFO nova.network.neutron [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating port b6a42460-29f0-496d-a7ba-d7ae2259f317 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:12:44 user nova-compute[71507]: INFO nova.compute.claims [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Claim successful on node user
Apr 13 15:12:44 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:12:44 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:12:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "241d70af-85a4-4798-9acd-e6431ca5c350" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:12:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Creating image(s)
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "/opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "/opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "/opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.policy [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquired lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:12:45 user nova-compute[71507]: INFO nova.compute.claims [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Claim successful on node user
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing instance network info cache due to event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] Acquiring lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.160s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.156s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk 1073741824" returned: 0 in 0.053s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Cannot resize image /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.objects.instance [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'migration_context' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Ensure instance console log exists: /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:12:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:12:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating instance_info_cache with network_info: [{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Releasing lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:12:46 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Creating image(s)
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Ensure instance console log exists: /opt/stack/data/nova/instances/179b6945-589d-402c-a89e-6b8d68725211/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Start _get_guest_xml network_info=[{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFEgzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '179b6945-589d-402c-a89e-6b8d68725211', 'attached_at': '', 'detached_at': '', 'volume_id': '0ddca559-4699-4c09-aca9-db61ea2e7961', 'serial': '0ddca559-4699-4c09-aca9-db61ea2e7961'}, 'attachment_id': '705ca9ca-c7c1-4bcc-ae06-c590cc7f0d56', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] Acquired lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.network.neutron [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:12:46 user nova-compute[71507]: INFO nova.virt.block_device [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Booting with volume 15da0023-8e48-431d-a2f0-2813a183bc2b at /dev/vda
Apr 13 15:12:46 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:46 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFEgzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:12:46 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:12:46 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:12:46 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.policy [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dc549309fa74c0a8eb2f44e5959ce92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac94a736e99f4f978f043f2b1b929284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.utils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83574f8-c335-4152-bcf8-9a8ab9794c42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:12:46 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e4767-1d1d-4556-b3b9-38b920803e7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[922cc13e-9591-4da6-b1d0-0145538b1eda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961] added
Apr 13 15:12:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2803cf77-182b-441a-92fc-cf4c3b2ac043]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bf07d2-04da-44d1-82af-7f831ef14750]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[590a93d4-c467-4965-b252-17b0c04df420]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9b94e1-6182-426b-b1b2-8edbf93ee781]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bac3b47-0dcf-4abe-9f07-29ba0a75acc8]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrFEgzON {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:12:46 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ae6644-5902-44f3-a71e-bae12d09efa1]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.utils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating existing volume attachment record: f915222b-fad3-4404-a609-484a0e72e11b {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrFEgzON" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d158d15-41c0-488e-82c1-f65f76856e28]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WrFEgzON'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9459dc8b-4822-454c-9706-c08edfe94419]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63adc3df-bacd-4bdd-9708-3a5a2adc484c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.network.neutron [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Successfully created port: 84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c53661-199b-4885-9229-031105ad781b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260]
Apr 13 15:12:46 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260] successful.
Apr 13 15:12:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8f027c-db5b-4079-b3b3-a200535a3fde]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b828a5-d785-4ef4-bddc-5f5c433823d1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:12:46 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89325f22-3ead-4edc-8824-ba4355fad867]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:46 user nova-compute[71507]: INFO nova.compute.manager [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Terminating instance
Apr 13 15:12:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.neutron [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updated VIF entry in instance network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.neutron [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating instance_info_cache with network_info: [{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b89f4e25-c114-4d14-bb36-8cb7daa55fc1 req-72b04b41-7191-48fd-adcd-b6d5cc44f8fe service nova] Releasing lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully created port: 5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFEgzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23162376437306534', 'path': '/dev/sdd'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162376437306534', 'path': '/dev/sdd'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-411290166',display_name='tempest-TestShelveInstance-server-411290166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-411290166',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-771163491',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:09:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7227559570b54e92be19d25938523b49',ramdisk_id='',reservation_id='r-btkem4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1754998277',owner_user_name='tempest-TestShelveInstance-1754998277-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:12:38Z,user_data=None,user_id='2fc0cce3df7540078438186f46ca4621',uuid=179b6945-589d-402c-a89e-6b8d68725211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converting VIF {"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lazy-loading 'pci_devices' on Instance uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:12:47 user nova-compute[71507]:   <uuid>179b6945-589d-402c-a89e-6b8d68725211</uuid>
Apr 13 15:12:47 user nova-compute[71507]:   <name>instance-0000000c</name>
Apr 13 15:12:47 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:12:47 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:12:47 user nova-compute[71507]:   <metadata>
Apr 13 15:12:47 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:12:47 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:12:47 user nova-compute[71507]:       <nova:name>tempest-TestShelveInstance-server-411290166</nova:name>
Apr 13 15:12:47 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:12:46</nova:creationTime>
Apr 13 15:12:47 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:12:47 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:12:47 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:12:47 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:12:47 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:12:47 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:12:47 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:12:47 user nova-compute[71507]:       <nova:owner>
Apr 13 15:12:47 user nova-compute[71507]:         <nova:user uuid="2fc0cce3df7540078438186f46ca4621">tempest-TestShelveInstance-1754998277-project-member</nova:user>
Apr 13 15:12:47 user nova-compute[71507]:         <nova:project uuid="7227559570b54e92be19d25938523b49">tempest-TestShelveInstance-1754998277</nova:project>
Apr 13 15:12:47 user nova-compute[71507]:       </nova:owner>
Apr 13 15:12:47 user nova-compute[71507]:       <nova:ports>
Apr 13 15:12:47 user nova-compute[71507]:         <nova:port uuid="b6a42460-29f0-496d-a7ba-d7ae2259f317">
Apr 13 15:12:47 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 15:12:47 user nova-compute[71507]:         </nova:port>
Apr 13 15:12:47 user nova-compute[71507]:       </nova:ports>
Apr 13 15:12:47 user nova-compute[71507]:     </nova:instance>
Apr 13 15:12:47 user nova-compute[71507]:   </metadata>
Apr 13 15:12:47 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:12:47 user nova-compute[71507]:     <system>
Apr 13 15:12:47 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:12:47 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:12:47 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:12:47 user nova-compute[71507]:       <entry name="serial">179b6945-589d-402c-a89e-6b8d68725211</entry>
Apr 13 15:12:47 user nova-compute[71507]:       <entry name="uuid">179b6945-589d-402c-a89e-6b8d68725211</entry>
Apr 13 15:12:47 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:12:47 user nova-compute[71507]:     </system>
Apr 13 15:12:47 user nova-compute[71507]:   </sysinfo>
Apr 13 15:12:47 user nova-compute[71507]:   <os>
Apr 13 15:12:47 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:12:47 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:12:47 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:12:47 user nova-compute[71507]:   </os>
Apr 13 15:12:47 user nova-compute[71507]:   <features>
Apr 13 15:12:47 user nova-compute[71507]:     <acpi/>
Apr 13 15:12:47 user nova-compute[71507]:     <apic/>
Apr 13 15:12:47 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:12:47 user nova-compute[71507]:   </features>
Apr 13 15:12:47 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:12:47 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:12:47 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:12:47 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:12:47 user nova-compute[71507]:   </clock>
Apr 13 15:12:47 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:12:47 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:12:47 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:12:47 user nova-compute[71507]:   </cpu>
Apr 13 15:12:47 user nova-compute[71507]:   <devices>
Apr 13 15:12:47 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:12:47 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:12:47 user nova-compute[71507]:       <source dev="/dev/sdd"/>
Apr 13 15:12:47 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:12:47 user nova-compute[71507]:       <serial>0ddca559-4699-4c09-aca9-db61ea2e7961</serial>
Apr 13 15:12:47 user nova-compute[71507]:     </disk>
Apr 13 15:12:47 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:12:47 user nova-compute[71507]:       <mac address="fa:16:3e:be:8a:4c"/>
Apr 13 15:12:47 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:12:47 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:12:47 user nova-compute[71507]:       <target dev="tapb6a42460-29"/>
Apr 13 15:12:47 user nova-compute[71507]:     </interface>
Apr 13 15:12:47 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:12:47 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/179b6945-589d-402c-a89e-6b8d68725211/console.log" append="off"/>
Apr 13 15:12:47 user nova-compute[71507]:     </serial>
Apr 13 15:12:47 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:12:47 user nova-compute[71507]:     <video>
Apr 13 15:12:47 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:12:47 user nova-compute[71507]:     </video>
Apr 13 15:12:47 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:12:47 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:12:47 user nova-compute[71507]:     </rng>
Apr 13 15:12:47 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:12:47 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:12:47 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:12:47 user nova-compute[71507]:     </memballoon>
Apr 13 15:12:47 user nova-compute[71507]:   </devices>
Apr 13 15:12:47 user nova-compute[71507]: </domain>
Apr 13 15:12:47 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-411290166',display_name='tempest-TestShelveInstance-server-411290166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-411290166',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-771163491',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:09:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7227559570b54e92be19d25938523b49',ramdisk_id='',reservation_id='r-btkem4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1754998277',owner_user_name='tempest-TestShelveInstance-1754998277-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:12:38Z,user_data=None,user_id='2fc0cce3df7540078438186f46ca4621',uuid=179b6945-589d-402c-a89e-6b8d68725211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converting VIF {"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG os_vif [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6a42460-29, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6a42460-29, col_values=(('external_ids', {'iface-id': 'b6a42460-29f0-496d-a7ba-d7ae2259f317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:8a:4c', 'vm-uuid': '179b6945-589d-402c-a89e-6b8d68725211'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:47 user nova-compute[71507]: INFO os_vif [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29')
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received event network-vif-unplugged-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] Acquiring lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] No waiting events found dispatching network-vif-unplugged-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-61f488a5-6948-490d-9818-4c9e15818225 req-49dbe906-fd7b-4181-8aea-1ab41a57ddc8 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received event network-vif-unplugged-4251e566-faf6-4d5a-a5be-048443db64db for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] No VIF found with MAC fa:16:3e:be:8a:4c, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.neutron [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Successfully updated port: 84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquired lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.neutron [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-changed-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Refreshing instance network info cache due to event network-changed-84611f06-d6ca-49e1-afe7-7723921e62dc. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] Acquiring lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:47 user nova-compute[71507]: DEBUG nova.network.neutron [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:12:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Instance destroyed successfully.
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'resources' on Instance uuid bfc41492-c482-4a9f-8a5b-9d7520dea39a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-548228514',display_name='tempest-VolumesAdminNegativeTest-server-548228514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-548228514',id=15,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:11:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7b81912360422a8413f8760b0cf7e1',ramdisk_id='',reservation_id='r-o2c7gqwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-721367972',owner_user_name='tempest-VolumesAdminNegativeTest-721367972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:11:00Z,user_data=None,user_id='54b07929cf2c404ab10ce944437e9e97',uuid=bfc41492-c482-4a9f-8a5b-9d7520dea39a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converting VIF {"id": "4251e566-faf6-4d5a-a5be-048443db64db", "address": "fa:16:3e:d1:ae:db", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4251e566-fa", "ovs_interfaceid": "4251e566-faf6-4d5a-a5be-048443db64db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:db,bridge_name='br-int',has_traffic_filtering=True,id=4251e566-faf6-4d5a-a5be-048443db64db,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4251e566-fa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG os_vif [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:db,bridge_name='br-int',has_traffic_filtering=True,id=4251e566-faf6-4d5a-a5be-048443db64db,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4251e566-fa') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4251e566-fa, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:48 user nova-compute[71507]: INFO os_vif [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:db,bridge_name='br-int',has_traffic_filtering=True,id=4251e566-faf6-4d5a-a5be-048443db64db,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4251e566-fa')
Apr 13 15:12:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Deleting instance files /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a_del
Apr 13 15:12:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Deletion of /opt/stack/data/nova/instances/bfc41492-c482-4a9f-8a5b-9d7520dea39a_del complete
Apr 13 15:12:48 user nova-compute[71507]: INFO nova.compute.manager [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Took 1.40 seconds to destroy the instance on the hypervisor.
Apr 13 15:12:48 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully created port: b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.neutron [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updating instance_info_cache with network_info: [{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Releasing lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance network_info: |[{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] Acquired lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.neutron [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Refreshing network info cache for port 84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Start _get_guest_xml network_info=[{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:12:48 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:48 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1504684221',display_name='tempest-AttachVolumeTestJSON-server-1504684221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1504684221',id=18,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w==',key_name='tempest-keypair-668401822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-0f5qbue4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=1aa74d14-db6f-41f5-b8af-32da312209d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.objects.instance [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:12:48 user nova-compute[71507]:   <uuid>1aa74d14-db6f-41f5-b8af-32da312209d3</uuid>
Apr 13 15:12:48 user nova-compute[71507]:   <name>instance-00000012</name>
Apr 13 15:12:48 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:12:48 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:12:48 user nova-compute[71507]:   <metadata>
Apr 13 15:12:48 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:12:48 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:12:48 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeTestJSON-server-1504684221</nova:name>
Apr 13 15:12:48 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:12:48</nova:creationTime>
Apr 13 15:12:48 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:12:48 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:12:48 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:12:48 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:12:48 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:12:48 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:12:48 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:12:48 user nova-compute[71507]:       <nova:owner>
Apr 13 15:12:48 user nova-compute[71507]:         <nova:user uuid="de1a698b103a47c0b2864eef54be648b">tempest-AttachVolumeTestJSON-157319562-project-member</nova:user>
Apr 13 15:12:48 user nova-compute[71507]:         <nova:project uuid="ceba33821a9b4f7aa81c2857c11261f1">tempest-AttachVolumeTestJSON-157319562</nova:project>
Apr 13 15:12:48 user nova-compute[71507]:       </nova:owner>
Apr 13 15:12:48 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:12:48 user nova-compute[71507]:       <nova:ports>
Apr 13 15:12:48 user nova-compute[71507]:         <nova:port uuid="84611f06-d6ca-49e1-afe7-7723921e62dc">
Apr 13 15:12:48 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 15:12:48 user nova-compute[71507]:         </nova:port>
Apr 13 15:12:48 user nova-compute[71507]:       </nova:ports>
Apr 13 15:12:48 user nova-compute[71507]:     </nova:instance>
Apr 13 15:12:48 user nova-compute[71507]:   </metadata>
Apr 13 15:12:48 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:12:48 user nova-compute[71507]:     <system>
Apr 13 15:12:48 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:12:48 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:12:48 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:12:48 user nova-compute[71507]:       <entry name="serial">1aa74d14-db6f-41f5-b8af-32da312209d3</entry>
Apr 13 15:12:48 user nova-compute[71507]:       <entry name="uuid">1aa74d14-db6f-41f5-b8af-32da312209d3</entry>
Apr 13 15:12:48 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:12:48 user nova-compute[71507]:     </system>
Apr 13 15:12:48 user nova-compute[71507]:   </sysinfo>
Apr 13 15:12:48 user nova-compute[71507]:   <os>
Apr 13 15:12:48 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:12:48 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:12:48 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:12:48 user nova-compute[71507]:   </os>
Apr 13 15:12:48 user nova-compute[71507]:   <features>
Apr 13 15:12:48 user nova-compute[71507]:     <acpi/>
Apr 13 15:12:48 user nova-compute[71507]:     <apic/>
Apr 13 15:12:48 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:12:48 user nova-compute[71507]:   </features>
Apr 13 15:12:48 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:12:48 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:12:48 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:12:48 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:12:48 user nova-compute[71507]:   </clock>
Apr 13 15:12:48 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:12:48 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:12:48 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:12:48 user nova-compute[71507]:   </cpu>
Apr 13 15:12:48 user nova-compute[71507]:   <devices>
Apr 13 15:12:48 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:12:48 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:12:48 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk"/>
Apr 13 15:12:48 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:12:48 user nova-compute[71507]:     </disk>
Apr 13 15:12:48 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:12:48 user nova-compute[71507]:       <mac address="fa:16:3e:a3:4a:01"/>
Apr 13 15:12:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:12:48 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:12:48 user nova-compute[71507]:       <target dev="tap84611f06-d6"/>
Apr 13 15:12:48 user nova-compute[71507]:     </interface>
Apr 13 15:12:48 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:12:48 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/console.log" append="off"/>
Apr 13 15:12:48 user nova-compute[71507]:     </serial>
Apr 13 15:12:48 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:12:48 user nova-compute[71507]:     <video>
Apr 13 15:12:48 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:12:48 user nova-compute[71507]:     </video>
Apr 13 15:12:48 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:12:48 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:12:48 user nova-compute[71507]:     </rng>
Apr 13 15:12:48 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:12:48 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:12:48 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:12:48 user nova-compute[71507]:     </memballoon>
Apr 13 15:12:48 user nova-compute[71507]:   </devices>
Apr 13 15:12:48 user nova-compute[71507]: </domain>
Apr 13 15:12:48 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1504684221',display_name='tempest-AttachVolumeTestJSON-server-1504684221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1504684221',id=18,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w==',key_name='tempest-keypair-668401822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-0f5qbue4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=1aa74d14-db6f-41f5-b8af-32da312209d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG os_vif [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84611f06-d6, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84611f06-d6, col_values=(('external_ids', {'iface-id': '84611f06-d6ca-49e1-afe7-7723921e62dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:4a:01', 'vm-uuid': '1aa74d14-db6f-41f5-b8af-32da312209d3'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:48 user nova-compute[71507]: INFO os_vif [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6')
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:12:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No VIF found with MAC fa:16:3e:a3:4a:01, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully created port: dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:49 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Took 1.05 seconds to deallocate network for instance.
Apr 13 15:12:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] No waiting events found dispatching network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:49 user nova-compute[71507]: WARNING nova.compute.manager [req-d8e370fb-629c-4bcc-8c23-743b82f9e4ee req-b29d9ac4-f95b-43f4-b9a2-e57ddf5522ce service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received unexpected event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.network.neutron [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updated VIF entry in instance network info cache for port 84611f06-d6ca-49e1-afe7-7723921e62dc. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.network.neutron [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updating instance_info_cache with network_info: [{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d23e8ff7-561d-467d-a445-2823f129d9ca req-cd99ec4c-5971-4efd-8442-fa45095977ec service nova] Releasing lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received event network-vif-plugged-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] Acquiring lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] No waiting events found dispatching network-vif-plugged-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:49 user nova-compute[71507]: WARNING nova.compute.manager [req-b49a177e-20ae-4661-b2c9-19399ab6297f req-8153d507-b643-4e89-98d3-0ae1f969afa8 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received unexpected event network-vif-plugged-4251e566-faf6-4d5a-a5be-048443db64db for instance with vm_state deleted and task_state None.
Apr 13 15:12:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully created port: c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:12:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-9bb210cf-4f13-4081-a5d6-5cf8c3cdbbe0 req-13ba5ae8-5b95-4923-9ddf-951d3b417424 service nova] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Received event network-vif-deleted-4251e566-faf6-4d5a-a5be-048443db64db {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:50 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Deleted allocations for instance bfc41492-c482-4a9f-8a5b-9d7520dea39a
Apr 13 15:12:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ec5895de-d2a9-408d-8460-7b790020e663 tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "bfc41492-c482-4a9f-8a5b-9d7520dea39a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.187s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:50 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully created port: 0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:12:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:51 user nova-compute[71507]: INFO nova.virt.block_device [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Booting with volume 66aa0088-0ff5-4f9a-ad2c-5917811cd32b at /dev/vdb
Apr 13 15:12:51 user nova-compute[71507]: DEBUG os_brick.utils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d4a2c5-0f74-4a33-8480-30b736202ede]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088ff04-a225-4705-88fe-b1d3a00a46fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7269b0e-e0e2-4838-aa74-c4e6eb931a80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7579c3e7-70a1-4d0f-9558-0980c6113f2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:12:51 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a83776-75ea-4652-b5bc-5f92958702fb]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG os_brick.utils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating existing volume attachment record: ff56d0d3-3ee5-4c39-a40e-d4ab0cd60e03 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] No waiting events found dispatching network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:51 user nova-compute[71507]: WARNING nova.compute.manager [req-105844ae-966b-4569-9bd1-3edb1d84c025 req-cf6670e9-39f4-4072-a6e9-35945da1cc9c service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received unexpected event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 15:12:51 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully updated port: 5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:51 user nova-compute[71507]: WARNING nova.compute.manager [req-0fa3f75b-ffc6-4fdb-a692-5e45e11f8845 req-40cc4ff4-27d3-4a0e-827b-d433ca9d8688 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state building and task_state spawning.
Apr 13 15:12:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully updated port: 458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398772.9089532, 179b6945-589d-402c-a89e-6b8d68725211 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:12:52 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] VM Resumed (Lifecycle Event)
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:12:52 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Instance spawned successfully.
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:12:52 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398772.9155757, 179b6945-589d-402c-a89e-6b8d68725211 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:12:52 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] VM Started (Lifecycle Event)
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:52 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:12:53 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:12:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fbd0e98f-b3da-44b3-84c1-060a80cca522 tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.020s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398773.3939552, 1aa74d14-db6f-41f5-b8af-32da312209d3 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:12:53 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] VM Resumed (Lifecycle Event)
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:12:53 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance spawned successfully.
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:12:53 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398773.3958378, 1aa74d14-db6f-41f5-b8af-32da312209d3 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:12:53 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] VM Started (Lifecycle Event)
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:12:53 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:12:53 user nova-compute[71507]: INFO nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Took 8.54 seconds to spawn the instance on the hypervisor.
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully updated port: 26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:12:53 user nova-compute[71507]: INFO nova.compute.manager [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Took 9.41 seconds to build instance.
Apr 13 15:12:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-72eb19b6-6f1d-4663-8648-b313c58ce86a tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.516s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-changed-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing instance network info cache due to event network-changed-5eac5fa3-8589-47e1-8c93-bb65b7b095a1. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Acquiring lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Acquired lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing network info cache for port 5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:12:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Releasing lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:12:54 user nova-compute[71507]: WARNING nova.compute.manager [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state active and task_state None.
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-changed-458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing instance network info cache due to event network-changed-458d18a0-cd93-4e5f-8d97-842f7d0dc73d. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Acquiring lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Acquired lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing network info cache for port 458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully updated port: b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Releasing lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-changed-26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing instance network info cache due to event network-changed-26419cbf-54b6-47ab-a068-356727e4a6ca. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Acquiring lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Acquired lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing network info cache for port 26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-462f4b30-f053-44e6-9717-2d815cca65b9 req-9750b49e-9bb8-4a35-b998-23357320de3e service nova] Releasing lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:55 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully updated port: dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-changed-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing instance network info cache due to event network-changed-b572fcf6-8374-49f4-b760-dc845d794668. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Acquiring lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Acquired lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing network info cache for port b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:12:56 user nova-compute[71507]: INFO nova.virt.block_device [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Booting with volume 81beedc0-0e22-4d24-9f34-375b2890a9f8 at /dev/vdc
Apr 13 15:12:56 user nova-compute[71507]: DEBUG os_brick.utils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba87b74-8c73-40d3-b059-a91f9fa7453b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b217a3e-778f-42f4-84c2-1c6b04f7de21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully updated port: c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ece178-459e-4d9c-b857-d5d60660107c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[224ab836-9f9f-434a-9ad9-0d423e737640]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:12:56 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f897851-7199-40c9-874b-fcfdd25cb5c0]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG os_brick.utils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating existing volume attachment record: 12e5f490-0fb0-400c-95a1-ede43bb6c005 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Releasing lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-changed-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing instance network info cache due to event network-changed-dda3844e-0bda-47ff-8de6-25b9cde47976. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Acquiring lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Acquired lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing network info cache for port dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398761.6806881, 1c9a3524-caeb-4333-ae2b-1080115026fd => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:12:56 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] VM Stopped (Lifecycle Event)
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5a8b20d7-7cb0-4075-9d22-8e55b96b1bc5 None None] [instance: 1c9a3524-caeb-4333-ae2b-1080115026fd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7e22b27e-4dca-4c5f-976f-6967515dd6f5 req-8678d403-ec7d-4049-aa45-973a150a4b3a service nova] Releasing lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:57 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Successfully updated port: 0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:12:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquired lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:57 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:12:57 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:12:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-changed-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:12:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing instance network info cache due to event network-changed-c6f28318-b210-4a1d-8954-d7e8dc4b19e2. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:12:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Acquiring lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:12:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:12:59 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [{"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:12:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Releasing lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:12:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance network_info: |[{"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:12:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Acquired lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:12:59 user nova-compute[71507]: DEBUG nova.network.neutron [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing network info cache for port c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updated VIF entry in instance network info cache for port c6f28318-b210-4a1d-8954-d7e8dc4b19e2. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [{"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Releasing lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-changed-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing instance network info cache due to event network-changed-0f04a8c8-b74c-4ecf-9a72-0628b196102c. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Acquiring lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Acquired lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing network info cache for port 0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG nova.objects.instance [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'flavor' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:00 user nova-compute[71507]: INFO nova.compute.manager [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Attaching volume f29176ab-5dde-4b23-9e8d-4aee8409dcb0 to /dev/vdb
Apr 13 15:13:00 user nova-compute[71507]: DEBUG os_brick.utils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07336220-29c4-4c68-b2c1-3d85fcb554fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updated VIF entry in instance network info cache for port 0f04a8c8-b74c-4ecf-9a72-0628b196102c. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [{"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa10f510-dba5-4472-84fe-cd77dbababe2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f524688-a8ad-4db2-bf92-e571b90ba1ef req-1039121d-43ff-41df-8615-a5e460b580aa service nova] Releasing lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a271e94-f98e-4812-b17e-da47893fb280]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf59a26-02d3-4fd2-b41c-e6efdcc49830]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:13:01 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[35de6b95-378a-4e62-9a3a-125c557c020e]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.utils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updating existing volume attachment record: f6c29acb-3146-44c7-9b9d-1629bbc66746 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:13:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Creating image(s)
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Ensure instance console log exists: /opt/stack/data/nova/instances/241d70af-85a4-4798-9acd-e6431ca5c350/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Start _get_guest_xml network_info=[{"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHxyUAuX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '241d70af-85a4-4798-9acd-e6431ca5c350', 'attached_at': '', 'detached_at': '', 'volume_id': '15da0023-8e48-431d-a2f0-2813a183bc2b', 'serial': '15da0023-8e48-431d-a2f0-2813a183bc2b'}, 'attachment_id': 'f915222b-fad3-4404-a609-484a0e72e11b', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PysJCTop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '241d70af-85a4-4798-9acd-e6431ca5c350', 'attached_at': '', 'detached_at': '', 'volume_id': '66aa0088-0ff5-4f9a-ad2c-5917811cd32b', 'serial': '66aa0088-0ff5-4f9a-ad2c-5917811cd32b'}, 'attachment_id': 'ff56d0d3-3ee5-4c39-a40e-d4ab0cd60e03', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxJTVBuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '241d70af-85a4-4798-9acd-e6431ca5c350', 'attached_at': '', 'detached_at': '', 'volume_id': '81beedc0-0e22-4d24-9f34-375b2890a9f8', 'serial': '81beedc0-0e22-4d24-9f34-375b2890a9f8'}, 'attachment_id': '12e5f490-0fb0-400c-95a1-ede43bb6c005', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:13:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:13:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHxyUAuX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:13:01 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:01 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:01 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94790111-740e-46af-a3dd-122dbefe3dc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:13:01 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[303efaa8-7450-4921-b279-bfe3fe07ee09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b] added
Apr 13 15:13:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a3d42f-a488-496b-ba80-9cf30bb23622]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8da315-0d7e-4669-afd4-7d0437645b66]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHxyUAuX {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHxyUAuX" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a610262b-0732-4763-81b2-541c5859618a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vHxyUAuX'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[462c612f-357a-4b9d-b6a1-545091f98cfa]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2d71a9-512d-4406-aa38-e9946f85d7cf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2933a490-6d3d-4a9c-9858-ac609c0d3e63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b, portal: 172.16.0.220,3260]
Apr 13 15:13:01 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b, portal: 172.16.0.220,3260] successful.
Apr 13 15:13:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6da586-7e6e-4e48-8a6b-df0773e690ff]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00bcbcc-ae9d-4bf0-b7cd-fc0248e7589f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:01 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3cccfe-b3be-46f2-be7d-e5c8b0e5782b]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:13:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHxyUAuX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23264656262333362', 'path': '/dev/sde'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264656262333362', 'path': '/dev/sde'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PysJCTop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:13:02 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.013s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:02 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:02 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[357b7e69-b951-4ff9-bb15-130eba3a5204]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:13:02 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bee2b74-c26c-4922-9b7c-9ba8c4c83940]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b] added
Apr 13 15:13:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9ef61-6529-41f4-8785-85c0e945c8d5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d23b9e-eb8c-4a61-8018-7a3d33429623]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PysJCTop {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PysJCTop" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48fdb60-ce3a-4e14-b923-44fc0bef6c0b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PysJCTop'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce69ba4d-157d-407c-a27c-27167c9173df]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb217a94-5c16-4a42-bce6-04a24685b9c1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:02 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:02 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:02 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:02 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:02 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:02 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[786a9092-107a-48c3-90e9-362eeae42c23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b, portal: 172.16.0.220,3260]
Apr 13 15:13:03 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b, portal: 172.16.0.220,3260] successful.
Apr 13 15:13:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec2fca8-1682-4729-93d4-d724f1692786]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[47500272-e959-44c3-9912-10528444efba]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:03 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:03 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:03 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:03 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:03 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:03 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:03 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:03 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccd137e-f1f0-428d-8b8b-d7ee1cc6279a]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PysJCTop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398768.2465172, bfc41492-c482-4a9f-8a5b-9d7520dea39a => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:03 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] VM Stopped (Lifecycle Event)
Apr 13 15:13:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6b0d6f9a-a981-4c0d-9836-85a087455690 None None] [instance: bfc41492-c482-4a9f-8a5b-9d7520dea39a] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23935666630316138', 'path': '/dev/sdf'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935666630316138', 'path': '/dev/sdf'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxJTVBuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:13:04 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:04 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:04 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f2fcf2-b8ef-4a85-bab7-4de4c389d345]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:13:04 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e6aa8d-e67d-4a97-b6a0-f565bd147cb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8] added
Apr 13 15:13:04 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4eb02e-7bb2-45fe-8f64-830ddcb7b35d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df6a7c-6c33-4081-b7f0-8dbce5795820]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vxJTVBuM {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vxJTVBuM" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aaf514-f47b-41ea-bf46-33b751b88cda]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vxJTVBuM'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c63712-27f4-4c13-9ed5-34eb4a0e8659]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82f931d-3717-4b0f-8e6c-520f4044d5e4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:04 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:04 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0158b2-88c6-4a13-8138-0cde3ac9d98b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8, portal: 172.16.0.220,3260]
Apr 13 15:13:04 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8, portal: 172.16.0.220,3260] successful.
Apr 13 15:13:04 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[017dc154-aad4-4131-a607-dee3e982d6bd]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c70f92-13bf-4275-bc62-4666a8463e88]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:04 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:04 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a163586d-c360-47d6-80c4-3abac70cb36a]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:04 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxJTVBuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26661653735326236', 'path': '/dev/sdg'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661653735326236', 'path': '/dev/sdg'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:3f:bc,bridge_name='br-int',has_traffic_filtering=True,id=5eac5fa3-8589-47e1-8c93-bb65b7b095a1,network=Network(c6073972-8aae-444d-95f2-fbc4e4a63d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eac5fa3-85') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:e2,bridge_name='br-int',has_traffic_filtering=True,id=458d18a0-cd93-4e5f-8d97-842f7d0dc73d,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458d18a0-cd') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:7b:cb,bridge_name='br-int',has_traffic_filtering=True,id=26419cbf-54b6-47ab-a068-356727e4a6ca,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26419cbf-54') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:39,bridge_name='br-int',has_traffic_filtering=True,id=b572fcf6-8374-49f4-b760-dc845d794668,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572fcf6-83') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b6:c9,bridge_name='br-int',has_traffic_filtering=True,id=dda3844e-0bda-47ff-8de6-25b9cde47976,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda3844e-0b') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:15:df,bridge_name='br-int',has_traffic_filtering=True,id=c6f28318-b210-4a1d-8954-d7e8dc4b19e2,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f28318-b2') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0f04a8c8-b74c-4ecf-9a72-0628b196102c,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f04a8c8-b7') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lazy-loading 'pci_devices' on Instance uuid 241d70af-85a4-4798-9acd-e6431ca5c350 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:13:05 user nova-compute[71507]:   <uuid>241d70af-85a4-4798-9acd-e6431ca5c350</uuid>
Apr 13 15:13:05 user nova-compute[71507]:   <name>instance-00000013</name>
Apr 13 15:13:05 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:13:05 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:13:05 user nova-compute[71507]:   <metadata>
Apr 13 15:13:05 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:13:05 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:13:05 user nova-compute[71507]:       <nova:name>tempest-device-tagging-server-286688180</nova:name>
Apr 13 15:13:05 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:13:01</nova:creationTime>
Apr 13 15:13:05 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:13:05 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:13:05 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:13:05 user nova-compute[71507]:       <nova:owner>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:user uuid="9dc549309fa74c0a8eb2f44e5959ce92">tempest-TaggedBootDevicesTest_v242-379148639-project-member</nova:user>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:project uuid="ac94a736e99f4f978f043f2b1b929284">tempest-TaggedBootDevicesTest_v242-379148639</nova:project>
Apr 13 15:13:05 user nova-compute[71507]:       </nova:owner>
Apr 13 15:13:05 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:13:05 user nova-compute[71507]:       <nova:ports>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:port uuid="5eac5fa3-8589-47e1-8c93-bb65b7b095a1">
Apr 13 15:13:05 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 15:13:05 user nova-compute[71507]:         </nova:port>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:port uuid="458d18a0-cd93-4e5f-8d97-842f7d0dc73d">
Apr 13 15:13:05 user nova-compute[71507]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Apr 13 15:13:05 user nova-compute[71507]:         </nova:port>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:port uuid="26419cbf-54b6-47ab-a068-356727e4a6ca">
Apr 13 15:13:05 user nova-compute[71507]:           <nova:ip type="fixed" address="10.1.1.59" ipVersion="4"/>
Apr 13 15:13:05 user nova-compute[71507]:         </nova:port>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:port uuid="b572fcf6-8374-49f4-b760-dc845d794668">
Apr 13 15:13:05 user nova-compute[71507]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Apr 13 15:13:05 user nova-compute[71507]:         </nova:port>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:port uuid="dda3844e-0bda-47ff-8de6-25b9cde47976">
Apr 13 15:13:05 user nova-compute[71507]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Apr 13 15:13:05 user nova-compute[71507]:         </nova:port>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:port uuid="c6f28318-b210-4a1d-8954-d7e8dc4b19e2">
Apr 13 15:13:05 user nova-compute[71507]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 15:13:05 user nova-compute[71507]:         </nova:port>
Apr 13 15:13:05 user nova-compute[71507]:         <nova:port uuid="0f04a8c8-b74c-4ecf-9a72-0628b196102c">
Apr 13 15:13:05 user nova-compute[71507]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 15:13:05 user nova-compute[71507]:         </nova:port>
Apr 13 15:13:05 user nova-compute[71507]:       </nova:ports>
Apr 13 15:13:05 user nova-compute[71507]:     </nova:instance>
Apr 13 15:13:05 user nova-compute[71507]:   </metadata>
Apr 13 15:13:05 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:13:05 user nova-compute[71507]:     <system>
Apr 13 15:13:05 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:13:05 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:13:05 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:13:05 user nova-compute[71507]:       <entry name="serial">241d70af-85a4-4798-9acd-e6431ca5c350</entry>
Apr 13 15:13:05 user nova-compute[71507]:       <entry name="uuid">241d70af-85a4-4798-9acd-e6431ca5c350</entry>
Apr 13 15:13:05 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:13:05 user nova-compute[71507]:     </system>
Apr 13 15:13:05 user nova-compute[71507]:   </sysinfo>
Apr 13 15:13:05 user nova-compute[71507]:   <os>
Apr 13 15:13:05 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:13:05 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:13:05 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:13:05 user nova-compute[71507]:   </os>
Apr 13 15:13:05 user nova-compute[71507]:   <features>
Apr 13 15:13:05 user nova-compute[71507]:     <acpi/>
Apr 13 15:13:05 user nova-compute[71507]:     <apic/>
Apr 13 15:13:05 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:13:05 user nova-compute[71507]:   </features>
Apr 13 15:13:05 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:13:05 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:13:05 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:13:05 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:13:05 user nova-compute[71507]:   </clock>
Apr 13 15:13:05 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:13:05 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:13:05 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:13:05 user nova-compute[71507]:   </cpu>
Apr 13 15:13:05 user nova-compute[71507]:   <devices>
Apr 13 15:13:05 user nova-compute[71507]:     <disk type="file" device="cdrom">
Apr 13 15:13:05 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 15:13:05 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/241d70af-85a4-4798-9acd-e6431ca5c350/disk.config"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="hda" bus="ide"/>
Apr 13 15:13:05 user nova-compute[71507]:     </disk>
Apr 13 15:13:05 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:13:05 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:13:05 user nova-compute[71507]:       <source dev="/dev/sde"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <serial>15da0023-8e48-431d-a2f0-2813a183bc2b</serial>
Apr 13 15:13:05 user nova-compute[71507]:     </disk>
Apr 13 15:13:05 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:13:05 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:13:05 user nova-compute[71507]:       <source dev="/dev/sdf"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <serial>66aa0088-0ff5-4f9a-ad2c-5917811cd32b</serial>
Apr 13 15:13:05 user nova-compute[71507]:     </disk>
Apr 13 15:13:05 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:13:05 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:13:05 user nova-compute[71507]:       <source dev="/dev/sdg"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="vdc" bus="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <serial>81beedc0-0e22-4d24-9f34-375b2890a9f8</serial>
Apr 13 15:13:05 user nova-compute[71507]:     </disk>
Apr 13 15:13:05 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:13:05 user nova-compute[71507]:       <mac address="fa:16:3e:f1:3f:bc"/>
Apr 13 15:13:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="tap5eac5fa3-85"/>
Apr 13 15:13:05 user nova-compute[71507]:     </interface>
Apr 13 15:13:05 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:13:05 user nova-compute[71507]:       <mac address="fa:16:3e:0d:e4:e2"/>
Apr 13 15:13:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="tap458d18a0-cd"/>
Apr 13 15:13:05 user nova-compute[71507]:     </interface>
Apr 13 15:13:05 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:13:05 user nova-compute[71507]:       <mac address="fa:16:3e:5f:7b:cb"/>
Apr 13 15:13:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="tap26419cbf-54"/>
Apr 13 15:13:05 user nova-compute[71507]:     </interface>
Apr 13 15:13:05 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:13:05 user nova-compute[71507]:       <mac address="fa:16:3e:2f:df:39"/>
Apr 13 15:13:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="tapb572fcf6-83"/>
Apr 13 15:13:05 user nova-compute[71507]:     </interface>
Apr 13 15:13:05 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:13:05 user nova-compute[71507]:       <mac address="fa:16:3e:06:b6:c9"/>
Apr 13 15:13:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="tapdda3844e-0b"/>
Apr 13 15:13:05 user nova-compute[71507]:     </interface>
Apr 13 15:13:05 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:13:05 user nova-compute[71507]:       <mac address="fa:16:3e:00:15:df"/>
Apr 13 15:13:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="tapc6f28318-b2"/>
Apr 13 15:13:05 user nova-compute[71507]:     </interface>
Apr 13 15:13:05 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:13:05 user nova-compute[71507]:       <mac address="fa:16:3e:fb:6e:a9"/>
Apr 13 15:13:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:13:05 user nova-compute[71507]:       <target dev="tap0f04a8c8-b7"/>
Apr 13 15:13:05 user nova-compute[71507]:     </interface>
Apr 13 15:13:05 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:13:05 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/241d70af-85a4-4798-9acd-e6431ca5c350/console.log" append="off"/>
Apr 13 15:13:05 user nova-compute[71507]:     </serial>
Apr 13 15:13:05 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:13:05 user nova-compute[71507]:     <video>
Apr 13 15:13:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:05 user nova-compute[71507]:     </video>
Apr 13 15:13:05 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:13:05 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:13:05 user nova-compute[71507]:     </rng>
Apr 13 15:13:05 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:13:05 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:13:05 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:13:05 user nova-compute[71507]:     </memballoon>
Apr 13 15:13:05 user nova-compute[71507]:   </devices>
Apr 13 15:13:05 user nova-compute[71507]: </domain>
Apr 13 15:13:05 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:3f:bc,bridge_name='br-int',has_traffic_filtering=True,id=5eac5fa3-8589-47e1-8c93-bb65b7b095a1,network=Network(c6073972-8aae-444d-95f2-fbc4e4a63d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eac5fa3-85') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:3f:bc,bridge_name='br-int',has_traffic_filtering=True,id=5eac5fa3-8589-47e1-8c93-bb65b7b095a1,network=Network(c6073972-8aae-444d-95f2-fbc4e4a63d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eac5fa3-85') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5eac5fa3-85, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5eac5fa3-85, col_values=(('external_ids', {'iface-id': '5eac5fa3-8589-47e1-8c93-bb65b7b095a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:3f:bc', 'vm-uuid': '241d70af-85a4-4798-9acd-e6431ca5c350'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: INFO os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:3f:bc,bridge_name='br-int',has_traffic_filtering=True,id=5eac5fa3-8589-47e1-8c93-bb65b7b095a1,network=Network(c6073972-8aae-444d-95f2-fbc4e4a63d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eac5fa3-85')
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:e2,bridge_name='br-int',has_traffic_filtering=True,id=458d18a0-cd93-4e5f-8d97-842f7d0dc73d,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458d18a0-cd') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:e2,bridge_name='br-int',has_traffic_filtering=True,id=458d18a0-cd93-4e5f-8d97-842f7d0dc73d,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458d18a0-cd') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap458d18a0-cd, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap458d18a0-cd, col_values=(('external_ids', {'iface-id': '458d18a0-cd93-4e5f-8d97-842f7d0dc73d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:e4:e2', 'vm-uuid': '241d70af-85a4-4798-9acd-e6431ca5c350'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: INFO os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:e2,bridge_name='br-int',has_traffic_filtering=True,id=458d18a0-cd93-4e5f-8d97-842f7d0dc73d,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458d18a0-cd')
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:7b:cb,bridge_name='br-int',has_traffic_filtering=True,id=26419cbf-54b6-47ab-a068-356727e4a6ca,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26419cbf-54') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:7b:cb,bridge_name='br-int',has_traffic_filtering=True,id=26419cbf-54b6-47ab-a068-356727e4a6ca,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26419cbf-54') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26419cbf-54, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26419cbf-54, col_values=(('external_ids', {'iface-id': '26419cbf-54b6-47ab-a068-356727e4a6ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:7b:cb', 'vm-uuid': '241d70af-85a4-4798-9acd-e6431ca5c350'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVExlJpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:13:05 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:05 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:05 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[24437e91-865e-400d-969f-1fcd97cfe26a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:13:05 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: INFO os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:7b:cb,bridge_name='br-int',has_traffic_filtering=True,id=26419cbf-54b6-47ab-a068-356727e4a6ca,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26419cbf-54')
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:39,bridge_name='br-int',has_traffic_filtering=True,id=b572fcf6-8374-49f4-b760-dc845d794668,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572fcf6-83') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:39,bridge_name='br-int',has_traffic_filtering=True,id=b572fcf6-8374-49f4-b760-dc845d794668,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572fcf6-83') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb572fcf6-83, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb572fcf6-83, col_values=(('external_ids', {'iface-id': 'b572fcf6-8374-49f4-b760-dc845d794668', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:df:39', 'vm-uuid': '241d70af-85a4-4798-9acd-e6431ca5c350'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[362fca5f-7d9d-4463-8614-a0a5bcfb987e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0] added
Apr 13 15:13:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[535c79c9-96d5-4525-8840-ff5dc99b5e94]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: INFO os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:39,bridge_name='br-int',has_traffic_filtering=True,id=b572fcf6-8374-49f4-b760-dc845d794668,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572fcf6-83')
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b6:c9,bridge_name='br-int',has_traffic_filtering=True,id=dda3844e-0bda-47ff-8de6-25b9cde47976,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda3844e-0b') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b6:c9,bridge_name='br-int',has_traffic_filtering=True,id=dda3844e-0bda-47ff-8de6-25b9cde47976,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda3844e-0b') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdda3844e-0b, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdda3844e-0b, col_values=(('external_ids', {'iface-id': 'dda3844e-0bda-47ff-8de6-25b9cde47976', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:b6:c9', 'vm-uuid': '241d70af-85a4-4798-9acd-e6431ca5c350'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e112c106-8ea1-4336-a3f3-dcadb525eed0]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVExlJpK {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVExlJpK" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce6223b-1084-4339-99b5-c784c071d8dd]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVExlJpK'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ca0b9-6c84-4987-abea-77a5a87db799]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: INFO os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b6:c9,bridge_name='br-int',has_traffic_filtering=True,id=dda3844e-0bda-47ff-8de6-25b9cde47976,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda3844e-0b')
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:15:df,bridge_name='br-int',has_traffic_filtering=True,id=c6f28318-b210-4a1d-8954-d7e8dc4b19e2,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f28318-b2') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:15:df,bridge_name='br-int',has_traffic_filtering=True,id=c6f28318-b210-4a1d-8954-d7e8dc4b19e2,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f28318-b2') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6f28318-b2, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6f28318-b2, col_values=(('external_ids', {'iface-id': 'c6f28318-b210-4a1d-8954-d7e8dc4b19e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:15:df', 'vm-uuid': '241d70af-85a4-4798-9acd-e6431ca5c350'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[745f1bf2-f268-4fa7-93ed-e4e5082fe488]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: INFO os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:15:df,bridge_name='br-int',has_traffic_filtering=True,id=c6f28318-b210-4a1d-8954-d7e8dc4b19e2,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f28318-b2')
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0f04a8c8-b74c-4ecf-9a72-0628b196102c,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f04a8c8-b7') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0f04a8c8-b74c-4ecf-9a72-0628b196102c,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f04a8c8-b7') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f04a8c8-b7, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f04a8c8-b7, col_values=(('external_ids', {'iface-id': '0f04a8c8-b74c-4ecf-9a72-0628b196102c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:6e:a9', 'vm-uuid': '241d70af-85a4-4798-9acd-e6431ca5c350'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf7f7ad-86f0-4ce2-92c1-81e9c7b16e9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260]
Apr 13 15:13:05 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260] successful.
Apr 13 15:13:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d2c4a4-25ce-4608-9f60-9dfd6de490bc]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:05 user nova-compute[71507]: INFO os_vif [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0f04a8c8-b74c-4ecf-9a72-0628b196102c,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f04a8c8-b7')
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a83dc3-eda1-443c-94cf-9f147d6fa4a1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:13:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] HCTL ('39', '-', '-', 0) found on session 19 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:13:05 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd0a26e-8f9a-4737-be27-8e1ca432e99f]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVExlJpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] No BDM found with device name hda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] No VIF found with MAC fa:16:3e:f1:3f:bc, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] No VIF found with MAC fa:16:3e:06:b6:c9, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:13:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Using config drive
Apr 13 15:13:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Creating config drive at /opt/stack/data/nova/instances/241d70af-85a4-4798-9acd-e6431ca5c350/disk.config
Apr 13 15:13:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/241d70af-85a4-4798-9acd-e6431ca5c350/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaqo7tyh2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/241d70af-85a4-4798-9acd-e6431ca5c350/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaqo7tyh2" returned: 0 in 0.063s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23961333961623934', 'path': '/dev/sdh'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961333961623934', 'path': '/dev/sdh'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG nova.objects.instance [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'flavor' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:13:07 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:13:07 user nova-compute[71507]:   <source dev="/dev/sdh"/>
Apr 13 15:13:07 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:13:07 user nova-compute[71507]:   <serial>f29176ab-5dde-4b23-9e8d-4aee8409dcb0</serial>
Apr 13 15:13:07 user nova-compute[71507]: </disk>
Apr 13 15:13:07 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No VIF found with MAC fa:16:3e:1f:ca:2e, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14d04394-0025-4af4-9feb-1c441387f53f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.006s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:08 user nova-compute[71507]: WARNING nova.compute.manager [req-b58678f3-963a-48ba-8f6f-8e1f1ca52fa3 req-82b8162d-4367-4d22-a15b-c3022c59ed53 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance with vm_state building and task_state spawning.
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:08 user nova-compute[71507]: WARNING nova.compute.manager [req-28804722-a812-499f-9210-dcf2cad8abc3 req-f5bf717e-42a5-4d36-a6e5-9783e02b1748 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-26419cbf-54b6-47ab-a068-356727e4a6ca for instance with vm_state building and task_state spawning.
Apr 13 15:13:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:10 user nova-compute[71507]: WARNING nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance with vm_state building and task_state spawning.
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:10 user nova-compute[71507]: WARNING nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d for instance with vm_state building and task_state spawning.
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:10 user nova-compute[71507]: WARNING nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d for instance with vm_state building and task_state spawning.
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:10 user nova-compute[71507]: WARNING nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-b572fcf6-8374-49f4-b760-dc845d794668 for instance with vm_state building and task_state spawning.
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:10 user nova-compute[71507]: WARNING nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-b572fcf6-8374-49f4-b760-dc845d794668 for instance with vm_state building and task_state spawning.
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:10 user nova-compute[71507]: WARNING nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-dda3844e-0bda-47ff-8de6-25b9cde47976 for instance with vm_state building and task_state spawning.
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:10 user nova-compute[71507]: WARNING nova.compute.manager [req-19398d26-b18d-41d9-aba3-b7d00f8fcda4 req-f93a9821-968b-4fd4-a0ae-18c6ef6d52c6 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-dda3844e-0bda-47ff-8de6-25b9cde47976 for instance with vm_state building and task_state spawning.
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:10 user nova-compute[71507]: WARNING nova.compute.manager [req-d451ea25-2c1c-4534-839b-6a82f524b51a req-1bcdb92d-3d45-4c5b-b466-afbcf981db34 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance with vm_state building and task_state spawning.
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:11 user nova-compute[71507]: WARNING nova.compute.manager [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-26419cbf-54b6-47ab-a068-356727e4a6ca for instance with vm_state building and task_state spawning.
Apr 13 15:13:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:11 user nova-compute[71507]: WARNING nova.compute.manager [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance with vm_state building and task_state spawning.
Apr 13 15:13:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:11 user nova-compute[71507]: WARNING nova.compute.manager [req-484cc3a4-896f-4471-92ad-5dc3afdb6f9a req-ae84b28d-91e7-41cd-86a6-af5abd34b697 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance with vm_state building and task_state spawning.
Apr 13 15:13:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398792.5007567, 241d70af-85a4-4798-9acd-e6431ca5c350 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] VM Resumed (Lifecycle Event)
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:12 user nova-compute[71507]: WARNING nova.compute.manager [req-d45fb2f6-d7ad-4522-8fa8-c4d175cd6181 req-c209b538-5887-4653-a8df-b20f6cbaa457 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance with vm_state building and task_state spawning.
Apr 13 15:13:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance spawned successfully.
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398792.5016146, 241d70af-85a4-4798-9acd-e6431ca5c350 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] VM Started (Lifecycle Event)
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:13:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:13:12 user nova-compute[71507]: INFO nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Took 11.35 seconds to spawn the instance on the hypervisor.
Apr 13 15:13:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:12 user nova-compute[71507]: INFO nova.compute.manager [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Took 27.74 seconds to build instance.
Apr 13 15:13:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9e2f8cc6-00cf-4110-a151-dec4a8989608 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "241d70af-85a4-4798-9acd-e6431ca5c350" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.850s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 15:13:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] There are 0 instances to clean {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 15:13:13 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing instance network info cache due to event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:13:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] Acquiring lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] Acquired lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:14 user nova-compute[71507]: DEBUG nova.network.neutron [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG nova.network.neutron [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updated VIF entry in instance network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG nova.network.neutron [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updating instance_info_cache with network_info: [{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cc7c08f3-326e-4a60-a453-df33c3ef7272 req-9f7418fe-a472-4b33-a1ea-58606a1bc88a service nova] Releasing lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing instance network info cache due to event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] Acquiring lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] Acquired lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG nova.network.neutron [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG nova.network.neutron [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updated VIF entry in instance network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG nova.network.neutron [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updating instance_info_cache with network_info: [{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11c80c9b-cbf4-435a-81c1-da9d94892b64 req-55b634d3-d909-4ec1-ac4b-af435873234d service nova] Releasing lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:16 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:13:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:16 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:13:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:17 user nova-compute[71507]: INFO nova.compute.manager [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Rebooting instance
Apr 13 15:13:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquired lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:17 user nova-compute[71507]: DEBUG nova.network.neutron [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:13:17 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Updating instance_info_cache with network_info: [{"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-1be0a3f9-0dae-4739-9f1e-0bb416a97719" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances with incomplete migration  {{(pid=71507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG nova.network.neutron [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updating instance_info_cache with network_info: [{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Releasing lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-unplugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] No waiting events found dispatching network-vif-unplugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:18 user nova-compute[71507]: WARNING nova.compute.manager [req-8633920f-1178-4c79-b98d-42e40b2e15e3 req-af038135-6353-4deb-a112-b651ab832652 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received unexpected event network-vif-unplugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 15:13:19 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Instance destroyed successfully.
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.objects.instance [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'resources' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-377290664',display_name='tempest-TestMinimumBasicScenario-server-377290664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-377290664',id=16,image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2KhvSB5J03IhhEg5JA/tj1cG2BDSPmL+5jFj0Unl3L4uq4s1XIJI5/ab1Vik7nfl+6oJRIw2tTNA1sr/iUc9YAfC+JNpGyE3k2x1hnrhzYW5YHXhMGc7caYhQEORU1KQ==',key_name='tempest-TestMinimumBasicScenario-1980539872',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='738150b0ec0c4ce887397f161c7e8c21',ramdisk_id='',reservation_id='r-ot41eewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1239780022',owner_user_name='tempest-TestMinimumBasicScenario-1239780022-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:19Z,user_data=None,user_id='c2322f71af2a478291bfb9d34046394c',uuid=05d57dd8-f51c-4709-a8b9-2f4aeb3039ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converting VIF {"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_vif [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7bf7380-3c, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:19 user nova-compute[71507]: INFO os_vif [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c')
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVExlJpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:13:19 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca81c657-4e94-4fbb-a8c0-8d985523177e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:13:19 user nova-compute[71507]: No targets found.
Apr 13 15:13:19 user nova-compute[71507]: iSNS:
Apr 13 15:13:19 user nova-compute[71507]: No targets found.
Apr 13 15:13:19 user nova-compute[71507]: STATIC:
Apr 13 15:13:19 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b
Apr 13 15:13:19 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:19 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:19 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b
Apr 13 15:13:19 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:19 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:19 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:13:19 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:19 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:19 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8
Apr 13 15:13:19 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:19 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:19 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1
Apr 13 15:13:19 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:19 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:19 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0
Apr 13 15:13:19 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:19 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:19 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:13:19 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:19 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:19 user nova-compute[71507]: FIRMWARE:
Apr 13 15:13:19 user nova-compute[71507]: No targets found.
Apr 13 15:13:19 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:13:19 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:13:19 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1642ef-2742-458c-ad98-a24ca68527ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cca3d3-c454-40a2-bcd9-bbf4446d91d3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:13:19 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab14155f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0'): ({'sdh'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Removing single pathed devices sdh {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a91d34-ed6f-4a0b-83ca-dc23767de0f6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[701cd632-8e9b-42ea-81fd-f4e22bd8e3c2]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flushing IO for device /dev/sdh {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da10b12-c18a-4a54-bbf6-9c2118819fbd]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f431251-179c-4bd9-9d8e-8263f1472b57]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] SCSI volumes sdh have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c05c33e-8259-4e16-b4eb-55089feb4c14]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5062ec5d-67b8-43c8-b9f9-2af70f4efbbb]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260]
Apr 13 15:13:19 user nova-compute[71507]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260] successful.
Apr 13 15:13:19 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde8b42c-99be-4ccd-b896-7f57c47cf67f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] <== disconnect_volume: return (337ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Start _get_guest_xml network_info=[{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=be4d330c-57e5-4ce4-afe8-c2b8be481516,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': 'be4d330c-57e5-4ce4-afe8-c2b8be481516'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVExlJpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '05d57dd8-f51c-4709-a8b9-2f4aeb3039ff', 'attached_at': '', 'detached_at': '', 'volume_id': 'f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 'serial': 'f29176ab-5dde-4b23-9e8d-4aee8409dcb0'}, 'attachment_id': 'f6c29acb-3146-44c7-9b9d-1629bbc66746', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:13:19 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:13:19 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=be4d330c-57e5-4ce4-afe8-c2b8be481516,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.objects.instance [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVExlJpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:13:19 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:19 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:19 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[887970bf-973c-4047-bb1a-31339b4858e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:13:19 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba8d91c-1fd2-4344-b009-96a6b74507fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0] added
Apr 13 15:13:19 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[146d28f1-378d-4b94-80f8-e687c77ced7b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b688dea4-c428-4681-b305-7f2a7e84c69c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVExlJpK {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVExlJpK" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00204f0-9574-4918-987a-325f53b8fbe9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVExlJpK'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b9a037-6b91-483b-8355-bd52acaf4004]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fac0cf3-a262-43ef-b148-ab13002856f8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f842c737-7912-4cd6-bf5a-028344d473bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260]
Apr 13 15:13:20 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260] successful.
Apr 13 15:13:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61f6054-825c-4958-b9c8-9f9655ed9509]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[911acaa5-c488-408f-88e7-0cbc991a919c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:13:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c7cd0e-a2af-4659-ad19-c39893b48348]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVExlJpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:13:20 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] No waiting events found dispatching network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:21 user nova-compute[71507]: WARNING nova.compute.manager [req-10d5ce1a-04d3-4902-a822-5c89923f04e0 req-665e9d56-0b5c-49b1-a1ed-59d8e2da42b1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received unexpected event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 15:13:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23961333961623934', 'path': '/dev/sdh'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961333961623934', 'path': '/dev/sdh'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-377290664',display_name='tempest-TestMinimumBasicScenario-server-377290664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-377290664',id=16,image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2KhvSB5J03IhhEg5JA/tj1cG2BDSPmL+5jFj0Unl3L4uq4s1XIJI5/ab1Vik7nfl+6oJRIw2tTNA1sr/iUc9YAfC+JNpGyE3k2x1hnrhzYW5YHXhMGc7caYhQEORU1KQ==',key_name='tempest-TestMinimumBasicScenario-1980539872',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='738150b0ec0c4ce887397f161c7e8c21',ramdisk_id='',reservation_id='r-ot41eewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1239780022',owner_user_name='tempest-TestMinimumBasicScenario-1239780022-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:19Z,user_data=None,user_id='c2322f71af2a478291bfb9d34046394c',uuid=05d57dd8-f51c-4709-a8b9-2f4aeb3039ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converting VIF {"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'pci_devices' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:13:21 user nova-compute[71507]:   <uuid>05d57dd8-f51c-4709-a8b9-2f4aeb3039ff</uuid>
Apr 13 15:13:21 user nova-compute[71507]:   <name>instance-00000010</name>
Apr 13 15:13:21 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:13:21 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:13:21 user nova-compute[71507]:   <metadata>
Apr 13 15:13:21 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:13:21 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:13:21 user nova-compute[71507]:       <nova:name>tempest-TestMinimumBasicScenario-server-377290664</nova:name>
Apr 13 15:13:21 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:13:19</nova:creationTime>
Apr 13 15:13:21 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:13:21 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:13:21 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:13:21 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:13:21 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:13:21 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:13:21 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:13:21 user nova-compute[71507]:       <nova:owner>
Apr 13 15:13:21 user nova-compute[71507]:         <nova:user uuid="c2322f71af2a478291bfb9d34046394c">tempest-TestMinimumBasicScenario-1239780022-project-member</nova:user>
Apr 13 15:13:21 user nova-compute[71507]:         <nova:project uuid="738150b0ec0c4ce887397f161c7e8c21">tempest-TestMinimumBasicScenario-1239780022</nova:project>
Apr 13 15:13:21 user nova-compute[71507]:       </nova:owner>
Apr 13 15:13:21 user nova-compute[71507]:       <nova:root type="image" uuid="be4d330c-57e5-4ce4-afe8-c2b8be481516"/>
Apr 13 15:13:21 user nova-compute[71507]:       <nova:ports>
Apr 13 15:13:21 user nova-compute[71507]:         <nova:port uuid="f7bf7380-3c36-4404-8bba-0f64c3fc59a3">
Apr 13 15:13:21 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 15:13:21 user nova-compute[71507]:         </nova:port>
Apr 13 15:13:21 user nova-compute[71507]:       </nova:ports>
Apr 13 15:13:21 user nova-compute[71507]:     </nova:instance>
Apr 13 15:13:21 user nova-compute[71507]:   </metadata>
Apr 13 15:13:21 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:13:21 user nova-compute[71507]:     <system>
Apr 13 15:13:21 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:13:21 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:13:21 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:13:21 user nova-compute[71507]:       <entry name="serial">05d57dd8-f51c-4709-a8b9-2f4aeb3039ff</entry>
Apr 13 15:13:21 user nova-compute[71507]:       <entry name="uuid">05d57dd8-f51c-4709-a8b9-2f4aeb3039ff</entry>
Apr 13 15:13:21 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:13:21 user nova-compute[71507]:     </system>
Apr 13 15:13:21 user nova-compute[71507]:   </sysinfo>
Apr 13 15:13:21 user nova-compute[71507]:   <os>
Apr 13 15:13:21 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:13:21 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:13:21 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:13:21 user nova-compute[71507]:   </os>
Apr 13 15:13:21 user nova-compute[71507]:   <features>
Apr 13 15:13:21 user nova-compute[71507]:     <acpi/>
Apr 13 15:13:21 user nova-compute[71507]:     <apic/>
Apr 13 15:13:21 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:13:21 user nova-compute[71507]:   </features>
Apr 13 15:13:21 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:13:21 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:13:21 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:13:21 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:13:21 user nova-compute[71507]:   </clock>
Apr 13 15:13:21 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:13:21 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:13:21 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:13:21 user nova-compute[71507]:   </cpu>
Apr 13 15:13:21 user nova-compute[71507]:   <devices>
Apr 13 15:13:21 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:13:21 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:13:21 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk"/>
Apr 13 15:13:21 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:13:21 user nova-compute[71507]:     </disk>
Apr 13 15:13:21 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:13:21 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:13:21 user nova-compute[71507]:       <source dev="/dev/sdh"/>
Apr 13 15:13:21 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:13:21 user nova-compute[71507]:       <serial>f29176ab-5dde-4b23-9e8d-4aee8409dcb0</serial>
Apr 13 15:13:21 user nova-compute[71507]:     </disk>
Apr 13 15:13:21 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:13:21 user nova-compute[71507]:       <mac address="fa:16:3e:1f:ca:2e"/>
Apr 13 15:13:21 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:21 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:13:21 user nova-compute[71507]:       <target dev="tapf7bf7380-3c"/>
Apr 13 15:13:21 user nova-compute[71507]:     </interface>
Apr 13 15:13:21 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:13:21 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/console.log" append="off"/>
Apr 13 15:13:21 user nova-compute[71507]:     </serial>
Apr 13 15:13:21 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:13:21 user nova-compute[71507]:     <video>
Apr 13 15:13:21 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:21 user nova-compute[71507]:     </video>
Apr 13 15:13:21 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:13:21 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:13:21 user nova-compute[71507]:     </rng>
Apr 13 15:13:21 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:13:21 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:13:21 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:13:21 user nova-compute[71507]:     </memballoon>
Apr 13 15:13:21 user nova-compute[71507]:   </devices>
Apr 13 15:13:21 user nova-compute[71507]: </domain>
Apr 13 15:13:21 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'trusted_certs' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84 --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Cannot resize image /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'migration_context' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-377290664',display_name='tempest-TestMinimumBasicScenario-server-377290664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-377290664',id=16,image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2KhvSB5J03IhhEg5JA/tj1cG2BDSPmL+5jFj0Unl3L4uq4s1XIJI5/ab1Vik7nfl+6oJRIw2tTNA1sr/iUc9YAfC+JNpGyE3k2x1hnrhzYW5YHXhMGc7caYhQEORU1KQ==',key_name='tempest-TestMinimumBasicScenario-1980539872',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='738150b0ec0c4ce887397f161c7e8c21',ramdisk_id='',reservation_id='r-ot41eewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1239780022',owner_user_name='tempest-TestMinimumBasicScenario-1239780022-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:13:19Z,user_data=None,user_id='c2322f71af2a478291bfb9d34046394c',uuid=05d57dd8-f51c-4709-a8b9-2f4aeb3039ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converting VIF {"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG os_vif [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7bf7380-3c, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7bf7380-3c, col_values=(('external_ids', {'iface-id': 'f7bf7380-3c36-4404-8bba-0f64c3fc59a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:ca:2e', 'vm-uuid': '05d57dd8-f51c-4709-a8b9-2f4aeb3039ff'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:21 user nova-compute[71507]: INFO os_vif [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c')
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:22 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] No waiting events found dispatching network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:23 user nova-compute[71507]: WARNING nova.compute.manager [req-960d77c5-0abe-473f-93e2-5e7e1801e0c3 req-e92151b2-53b5-4a2c-8ea7-2ff93b188344 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received unexpected event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:23 user nova-compute[71507]: INFO nova.compute.manager [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Unrescuing
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquired lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG nova.network.neutron [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG nova.network.neutron [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating instance_info_cache with network_info: [{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Releasing lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'flavor' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:13:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-changed-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Refreshing instance network info cache due to event network-changed-a534f901-d679-4443-bf28-aaba09bf631f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:13:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] Acquiring lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] Acquired lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:25 user nova-compute[71507]: DEBUG nova.network.neutron [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Refreshing network info cache for port a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:13:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398805.6523087, 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:26 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] VM Resumed (Lifecycle Event)
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] No waiting events found dispatching network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:26 user nova-compute[71507]: WARNING nova.compute.manager [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received unexpected event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:26 user nova-compute[71507]: WARNING nova.compute.manager [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:26 user nova-compute[71507]: WARNING nova.compute.manager [req-50a66717-1c27-4ed8-877d-41a05db21e1f req-73b5c168-9b87-44cb-bf36-5b5fdf4b7ae1 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Instance destroyed successfully.
Apr 13 15:13:26 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:13:26 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7412MB free_disk=26.119949340820312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Instance rebooted successfully.
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:13:26 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398805.6541104, 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:26 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] VM Started (Lifecycle Event)
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-638357af-ca79-4c16-aa3f-ef929ec39d0f tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.297s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 654608ee-5897-429a-b19c-6845d4e84818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 179b6945-589d-402c-a89e-6b8d68725211 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 241d70af-85a4-4798-9acd-e6431ca5c350 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing inventories for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating ProviderTree inventory for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing aggregate associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, aggregates: None {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing trait associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.886s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updated VIF entry in instance network info cache for port a534f901-d679-4443-bf28-aaba09bf631f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:13:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating instance_info_cache with network_info: [{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-517b530c-acaf-4929-b855-353f8a9599a5 req-5258174d-cf59-4aac-8e37-6e3596d351b4 service nova] Releasing lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG nova.compute.manager [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-changed-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG nova.compute.manager [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Refreshing instance network info cache due to event network-changed-a534f901-d679-4443-bf28-aaba09bf631f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] Acquiring lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] Acquired lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG nova.network.neutron [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Refreshing network info cache for port a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG nova.compute.manager [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG nova.compute.manager [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:27 user nova-compute[71507]: WARNING nova.compute.manager [req-07fcc372-1ecd-4761-8e44-7b45470fc198 req-f2822b6c-f6e4-49f2-97bd-b948ed20ded3 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:13:27 user nova-compute[71507]: DEBUG nova.network.neutron [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updated VIF entry in instance network info cache for port a534f901-d679-4443-bf28-aaba09bf631f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG nova.network.neutron [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating instance_info_cache with network_info: [{"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-29f7e22d-0d02-4b99-9f52-c33f34c5ab33 req-e8a7ce72-04a4-4856-86e5-e9feba7e4caa service nova] Releasing lock "refresh_cache-654608ee-5897-429a-b19c-6845d4e84818" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:27 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for 654608ee-5897-429a-b19c-6845d4e84818 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398809.8736992, 654608ee-5897-429a-b19c-6845d4e84818 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:29 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] VM Resumed (Lifecycle Event)
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b961056b-3f9d-47de-bee0-b11aee6bf9ad tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.compute.manager [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.compute.manager [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:29 user nova-compute[71507]: WARNING nova.compute.manager [req-b219de9f-ac2b-472d-8314-d93b80bd7dce req-5db05a0f-0b6d-4d11-82a3-7dcc62d1616e service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:13:29 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398809.8774242, 654608ee-5897-429a-b19c-6845d4e84818 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:29 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] VM Started (Lifecycle Event)
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:13:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:13:33 user nova-compute[71507]: INFO nova.compute.claims [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Claim successful on node user
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.network.neutron [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:13:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:13:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Creating image(s)
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "/opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "/opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.policy [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bdc942f33ca46c08bb143ed2efeb458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0cae04ab4b4157a7ef786d165789a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-changed-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Refreshing instance network info cache due to event network-changed-9c8ad360-aa62-4ef1-952f-d73f885baa89. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] Acquiring lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] Acquired lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG nova.network.neutron [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Refreshing network info cache for port 9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.167s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.150s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk 1073741824" returned: 0 in 0.057s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Cannot resize image /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG nova.objects.instance [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lazy-loading 'migration_context' on Instance uuid 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Ensure instance console log exists: /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG nova.network.neutron [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updated VIF entry in instance network info cache for port 9c8ad360-aa62-4ef1-952f-d73f885baa89. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG nova.network.neutron [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance_info_cache with network_info: [{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-44087bd2-bb33-4364-8706-9577742562fd req-38f4bae0-2ce6-4b83-b0b6-1a7af9a252ea service nova] Releasing lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:34 user nova-compute[71507]: DEBUG nova.network.neutron [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Successfully created port: ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Successfully updated port: ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "refresh_cache-9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquired lock "refresh_cache-9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received event network-changed-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Refreshing instance network info cache due to event network-changed-ec148848-53a7-4ed8-8105-7d95722393bc. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] Acquiring lock "refresh_cache-9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Updating instance_info_cache with network_info: [{"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Releasing lock "refresh_cache-9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Instance network_info: |[{"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] Acquired lock "refresh_cache-9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.network.neutron [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Refreshing network info cache for port ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Start _get_guest_xml network_info=[{"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:13:35 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:13:35 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:13:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1355034600',display_name='tempest-VolumesActionsTest-instance-1355034600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1355034600',id=20,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c0cae04ab4b4157a7ef786d165789a6',ramdisk_id='',reservation_id='r-6qxw2tre',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-119634704',owner_user_name='tempest-VolumesActionsTest-119634704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:13:34Z,user_data=None,user_id='3bdc942f33ca46c08bb143ed2efeb458',uuid=9bad86ad-6d5b-45f1-bcd8-4dea5be345ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converting VIF {"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:4f,bridge_name='br-int',has_traffic_filtering=True,id=ec148848-53a7-4ed8-8105-7d95722393bc,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec148848-53') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:13:36 user nova-compute[71507]:   <uuid>9bad86ad-6d5b-45f1-bcd8-4dea5be345ae</uuid>
Apr 13 15:13:36 user nova-compute[71507]:   <name>instance-00000014</name>
Apr 13 15:13:36 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:13:36 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:13:36 user nova-compute[71507]:   <metadata>
Apr 13 15:13:36 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:13:36 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:13:36 user nova-compute[71507]:       <nova:name>tempest-VolumesActionsTest-instance-1355034600</nova:name>
Apr 13 15:13:36 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:13:35</nova:creationTime>
Apr 13 15:13:36 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:13:36 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:13:36 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:13:36 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:13:36 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:13:36 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:13:36 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:13:36 user nova-compute[71507]:       <nova:owner>
Apr 13 15:13:36 user nova-compute[71507]:         <nova:user uuid="3bdc942f33ca46c08bb143ed2efeb458">tempest-VolumesActionsTest-119634704-project-member</nova:user>
Apr 13 15:13:36 user nova-compute[71507]:         <nova:project uuid="2c0cae04ab4b4157a7ef786d165789a6">tempest-VolumesActionsTest-119634704</nova:project>
Apr 13 15:13:36 user nova-compute[71507]:       </nova:owner>
Apr 13 15:13:36 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:13:36 user nova-compute[71507]:       <nova:ports>
Apr 13 15:13:36 user nova-compute[71507]:         <nova:port uuid="ec148848-53a7-4ed8-8105-7d95722393bc">
Apr 13 15:13:36 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 13 15:13:36 user nova-compute[71507]:         </nova:port>
Apr 13 15:13:36 user nova-compute[71507]:       </nova:ports>
Apr 13 15:13:36 user nova-compute[71507]:     </nova:instance>
Apr 13 15:13:36 user nova-compute[71507]:   </metadata>
Apr 13 15:13:36 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:13:36 user nova-compute[71507]:     <system>
Apr 13 15:13:36 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:13:36 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:13:36 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:13:36 user nova-compute[71507]:       <entry name="serial">9bad86ad-6d5b-45f1-bcd8-4dea5be345ae</entry>
Apr 13 15:13:36 user nova-compute[71507]:       <entry name="uuid">9bad86ad-6d5b-45f1-bcd8-4dea5be345ae</entry>
Apr 13 15:13:36 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:13:36 user nova-compute[71507]:     </system>
Apr 13 15:13:36 user nova-compute[71507]:   </sysinfo>
Apr 13 15:13:36 user nova-compute[71507]:   <os>
Apr 13 15:13:36 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:13:36 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:13:36 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:13:36 user nova-compute[71507]:   </os>
Apr 13 15:13:36 user nova-compute[71507]:   <features>
Apr 13 15:13:36 user nova-compute[71507]:     <acpi/>
Apr 13 15:13:36 user nova-compute[71507]:     <apic/>
Apr 13 15:13:36 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:13:36 user nova-compute[71507]:   </features>
Apr 13 15:13:36 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:13:36 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:13:36 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:13:36 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:13:36 user nova-compute[71507]:   </clock>
Apr 13 15:13:36 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:13:36 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:13:36 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:13:36 user nova-compute[71507]:   </cpu>
Apr 13 15:13:36 user nova-compute[71507]:   <devices>
Apr 13 15:13:36 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:13:36 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:13:36 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk"/>
Apr 13 15:13:36 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:13:36 user nova-compute[71507]:     </disk>
Apr 13 15:13:36 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:13:36 user nova-compute[71507]:       <mac address="fa:16:3e:f8:8f:4f"/>
Apr 13 15:13:36 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:36 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:13:36 user nova-compute[71507]:       <target dev="tapec148848-53"/>
Apr 13 15:13:36 user nova-compute[71507]:     </interface>
Apr 13 15:13:36 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:13:36 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/console.log" append="off"/>
Apr 13 15:13:36 user nova-compute[71507]:     </serial>
Apr 13 15:13:36 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:13:36 user nova-compute[71507]:     <video>
Apr 13 15:13:36 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:13:36 user nova-compute[71507]:     </video>
Apr 13 15:13:36 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:13:36 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:13:36 user nova-compute[71507]:     </rng>
Apr 13 15:13:36 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:13:36 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:13:36 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:13:36 user nova-compute[71507]:     </memballoon>
Apr 13 15:13:36 user nova-compute[71507]:   </devices>
Apr 13 15:13:36 user nova-compute[71507]: </domain>
Apr 13 15:13:36 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1355034600',display_name='tempest-VolumesActionsTest-instance-1355034600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1355034600',id=20,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c0cae04ab4b4157a7ef786d165789a6',ramdisk_id='',reservation_id='r-6qxw2tre',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-119634704',owner_user_name='tempest-VolumesActionsTest-119634704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:13:34Z,user_data=None,user_id='3bdc942f33ca46c08bb143ed2efeb458',uuid=9bad86ad-6d5b-45f1-bcd8-4dea5be345ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converting VIF {"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:4f,bridge_name='br-int',has_traffic_filtering=True,id=ec148848-53a7-4ed8-8105-7d95722393bc,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec148848-53') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG os_vif [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:4f,bridge_name='br-int',has_traffic_filtering=True,id=ec148848-53a7-4ed8-8105-7d95722393bc,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec148848-53') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec148848-53, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec148848-53, col_values=(('external_ids', {'iface-id': 'ec148848-53a7-4ed8-8105-7d95722393bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:8f:4f', 'vm-uuid': '9bad86ad-6d5b-45f1-bcd8-4dea5be345ae'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:36 user nova-compute[71507]: INFO os_vif [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:4f,bridge_name='br-int',has_traffic_filtering=True,id=ec148848-53a7-4ed8-8105-7d95722393bc,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec148848-53')
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] No VIF found with MAC fa:16:3e:f8:8f:4f, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Updated VIF entry in instance network info cache for port ec148848-53a7-4ed8-8105-7d95722393bc. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Updating instance_info_cache with network_info: [{"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a39eabda-e461-494b-8d93-91197a783caf req-ee9466f2-86f7-48ff-8c05-5b5a5c931c06 service nova] Releasing lock "refresh_cache-9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received event network-vif-plugged-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] Acquiring lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] No waiting events found dispatching network-vif-plugged-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:37 user nova-compute[71507]: WARNING nova.compute.manager [req-1dc9cb76-d967-49eb-80da-28780a4823c7 req-faab7822-0b87-439d-9f43-848905561214 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received unexpected event network-vif-plugged-ec148848-53a7-4ed8-8105-7d95722393bc for instance with vm_state building and task_state spawning.
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398819.7557862, 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:39 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] VM Resumed (Lifecycle Event)
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:13:39 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Instance spawned successfully.
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:13:39 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398819.7581713, 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:39 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] VM Started (Lifecycle Event)
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:13:39 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:13:39 user nova-compute[71507]: INFO nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Took 6.19 seconds to spawn the instance on the hypervisor.
Apr 13 15:13:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:39 user nova-compute[71507]: INFO nova.compute.manager [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Took 6.98 seconds to build instance.
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2e4c95d4-0613-4c27-9f43-f2c14853bc74 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.124s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received event network-vif-plugged-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] Acquiring lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] No waiting events found dispatching network-vif-plugged-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:40 user nova-compute[71507]: WARNING nova.compute.manager [req-3fd9fec1-6f37-4f80-ae7c-3613a84200ed req-0ec8120a-ee1e-463c-86b6-22202d163463 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received unexpected event network-vif-plugged-ec148848-53a7-4ed8-8105-7d95722393bc for instance with vm_state active and task_state None.
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:40 user nova-compute[71507]: INFO nova.compute.manager [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Terminating instance
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received event network-vif-unplugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] No waiting events found dispatching network-vif-unplugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-5e564bd4-ff1b-4a0b-bfee-231d5eeb0280 req-3cc81b5d-e727-4ce8-a126-b18ecb422f68 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received event network-vif-unplugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:13:40 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Instance destroyed successfully.
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.objects.instance [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lazy-loading 'resources' on Instance uuid 1be0a3f9-0dae-4739-9f1e-0bb416a97719 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1268328026',display_name='tempest-VolumesAdminNegativeTest-server-1268328026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1268328026',id=8,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7UiZBBPqbMTDNeH6e75E+1q+0ruGAE6pDAnPOoJW7nq6PcivT2tcES9p9mrLu8hWYaw2+Sm3p5lwGbApOi6N4MWBvGgfhOCip/2hL91LC4ATNbe75oeKHbSqHKlX+mxA==',key_name='tempest-keypair-38678878',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7b81912360422a8413f8760b0cf7e1',ramdisk_id='',reservation_id='r-gq0fle0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-721367972',owner_user_name='tempest-VolumesAdminNegativeTest-721367972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b07929cf2c404ab10ce944437e9e97',uuid=1be0a3f9-0dae-4739-9f1e-0bb416a97719,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converting VIF {"id": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "address": "fa:16:3e:3b:11:e1", "network": {"id": "ef80378f-a9cf-4f0f-80cd-90ff2384f88e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1325649950-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7b81912360422a8413f8760b0cf7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaee05dc-ae", "ovs_interfaceid": "daee05dc-ae07-4d68-94f3-7c2ee8039327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:11:e1,bridge_name='br-int',has_traffic_filtering=True,id=daee05dc-ae07-4d68-94f3-7c2ee8039327,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaee05dc-ae') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG os_vif [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:11:e1,bridge_name='br-int',has_traffic_filtering=True,id=daee05dc-ae07-4d68-94f3-7c2ee8039327,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaee05dc-ae') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaee05dc-ae, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:40 user nova-compute[71507]: INFO os_vif [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:11:e1,bridge_name='br-int',has_traffic_filtering=True,id=daee05dc-ae07-4d68-94f3-7c2ee8039327,network=Network(ef80378f-a9cf-4f0f-80cd-90ff2384f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaee05dc-ae')
Apr 13 15:13:40 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Deleting instance files /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719_del
Apr 13 15:13:40 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Deletion of /opt/stack/data/nova/instances/1be0a3f9-0dae-4739-9f1e-0bb416a97719_del complete
Apr 13 15:13:41 user nova-compute[71507]: INFO nova.compute.manager [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 15:13:41 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:13:41 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:13:41 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:13:41 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:13:41 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Took 0.78 seconds to deallocate network for instance.
Apr 13 15:13:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:42 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:13:42 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:13:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:42 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Deleted allocations for instance 1be0a3f9-0dae-4739-9f1e-0bb416a97719
Apr 13 15:13:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-032af722-c3bc-4046-b791-aef85dbc9d9c tempest-VolumesAdminNegativeTest-721367972 tempest-VolumesAdminNegativeTest-721367972-project-member] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received event network-vif-plugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] Acquiring lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] Lock "1be0a3f9-0dae-4739-9f1e-0bb416a97719-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] No waiting events found dispatching network-vif-plugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:13:42 user nova-compute[71507]: WARNING nova.compute.manager [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received unexpected event network-vif-plugged-daee05dc-ae07-4d68-94f3-7c2ee8039327 for instance with vm_state deleted and task_state None.
Apr 13 15:13:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-15c6d8a6-e5e6-41cd-8a5c-05f4a00f5746 req-2717fcf6-a0ef-4a56-b93a-f2a1de755da1 service nova] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Received event network-vif-deleted-daee05dc-ae07-4d68-94f3-7c2ee8039327 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:13:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_power_states {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 241d70af-85a4-4798-9acd-e6431ca5c350 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "25f57234-8818-44d3-b476-d6cfba7b2810" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "654608ee-5897-429a-b19c-6845d4e84818" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "179b6945-589d-402c-a89e-6b8d68725211" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "0a0a9548-9e57-4007-bafb-d418a4433473" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "241d70af-85a4-4798-9acd-e6431ca5c350" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:55 user nova-compute[71507]: WARNING oslo_messaging._drivers.amqpdriver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398820.9044523, 1be0a3f9-0dae-4739-9f1e-0bb416a97719 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:13:55 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] VM Stopped (Lifecycle Event)
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "654608ee-5897-429a-b19c-6845d4e84818" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "0a0a9548-9e57-4007-bafb-d418a4433473" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "25f57234-8818-44d3-b476-d6cfba7b2810" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "179b6945-589d-402c-a89e-6b8d68725211" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "241d70af-85a4-4798-9acd-e6431ca5c350" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:13:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7da806f0-7488-43a1-be4e-c981fdc12002 None None] [instance: 1be0a3f9-0dae-4739-9f1e-0bb416a97719] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:13:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:13:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:13:56 user nova-compute[71507]: INFO nova.compute.manager [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Detaching volume 5579543e-1e86-4db2-b6b5-4a2ff31d59b1
Apr 13 15:13:56 user nova-compute[71507]: INFO nova.virt.block_device [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Attempting to driver detach volume 5579543e-1e86-4db2-b6b5-4a2ff31d59b1 from mountpoint /dev/vdb
Apr 13 15:13:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Attempting to detach device vdb from instance 654608ee-5897-429a-b19c-6845d4e84818 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:13:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:13:56 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:13:56 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:13:56 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:13:56 user nova-compute[71507]:   <serial>5579543e-1e86-4db2-b6b5-4a2ff31d59b1</serial>
Apr 13 15:13:56 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:13:56 user nova-compute[71507]: </disk>
Apr 13 15:13:56 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:13:56 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Successfully detached device vdb from instance 654608ee-5897-429a-b19c-6845d4e84818 from the persistent domain config.
Apr 13 15:13:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 654608ee-5897-429a-b19c-6845d4e84818 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:13:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:13:56 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:13:56 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:13:56 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:13:56 user nova-compute[71507]:   <serial>5579543e-1e86-4db2-b6b5-4a2ff31d59b1</serial>
Apr 13 15:13:56 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:13:56 user nova-compute[71507]: </disk>
Apr 13 15:13:56 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681398837.4973376, 654608ee-5897-429a-b19c-6845d4e84818 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:13:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Successfully detached device vdb from instance 654608ee-5897-429a-b19c-6845d4e84818 from the live domain config.
Apr 13 15:13:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaBRmrGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:13:57 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ee3ec2-2c8e-4918-b191-bf4fd722f9d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:13:57 user nova-compute[71507]: No targets found.
Apr 13 15:13:57 user nova-compute[71507]: iSNS:
Apr 13 15:13:57 user nova-compute[71507]: No targets found.
Apr 13 15:13:57 user nova-compute[71507]: STATIC:
Apr 13 15:13:57 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b
Apr 13 15:13:57 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:57 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:57 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b
Apr 13 15:13:57 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:57 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:57 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:13:57 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:57 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:57 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8
Apr 13 15:13:57 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:57 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:57 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1
Apr 13 15:13:57 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:57 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:57 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0
Apr 13 15:13:57 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:57 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:57 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:13:57 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:13:57 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:13:57 user nova-compute[71507]: FIRMWARE:
Apr 13 15:13:57 user nova-compute[71507]: No targets found.
Apr 13 15:13:57 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:13:57 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:13:57 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ee7fb-b76a-4d03-b4b0-44537a43cac6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[332dcbb1-9849-48d8-8add-efc485ad21af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:13:57 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab142291b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe9dde-0160-4a52-b9cc-0f8b358a651f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[31952647-995f-4403-8616-b7acd0625aa7]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dfa922-507b-49bd-bfbb-82b3073e0acc]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[93842c22-2d3b-4e81-9fe0-5d0dc46b5af0]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad833a6c-b95c-4cf5-b563-6f8eb400fbe5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[da306c8d-ec0b-4e42-b392-8bcc4a345dae]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1, portal: 172.16.0.220,3260]
Apr 13 15:13:57 user nova-compute[71507]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1, portal: 172.16.0.220,3260] successful.
Apr 13 15:13:57 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5579543e-1e86-4db2-b6b5-4a2ff31d59b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c282ef71-ed8b-490b-82aa-c43555910dd3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] <== disconnect_volume: return (320ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:13:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:13:58 user nova-compute[71507]: DEBUG nova.objects.instance [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'flavor' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:13:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4f984970-9285-4a03-b942-5b9c31621cd5 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.799s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:03 user nova-compute[71507]: INFO nova.compute.manager [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Unrescuing
Apr 13 15:14:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:14:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquired lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:14:03 user nova-compute[71507]: DEBUG nova.network.neutron [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG nova.network.neutron [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updating instance_info_cache with network_info: [{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Releasing lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG nova.objects.instance [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'flavor' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:04 user nova-compute[71507]: WARNING nova.compute.manager [req-2c5e8aaa-b9f9-4ccd-afad-3b44ec2c32cc req-336c716f-af7a-481f-b804-3b83745ae114 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:14:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:04 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Instance destroyed successfully.
Apr 13 15:14:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:06 user nova-compute[71507]: WARNING nova.compute.manager [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:14:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:06 user nova-compute[71507]: WARNING nova.compute.manager [req-ad8168aa-be52-4f6b-b67a-e3cb21f9c214 req-f913152a-39ec-4a65-b446-8bf23f525719 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:14:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for f54cffe3-73da-468b-8252-b74cb4ba9653 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398848.4121494, f54cffe3-73da-468b-8252-b74cb4ba9653 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:14:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] VM Resumed (Lifecycle Event)
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-86a6bc27-5812-44c2-98fc-0e4e8b267e9f tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:14:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398848.4135003, f54cffe3-73da-468b-8252-b74cb4ba9653 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:14:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] VM Started (Lifecycle Event)
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:08 user nova-compute[71507]: WARNING nova.compute.manager [req-2d12bc8d-1fb5-4f05-92e3-e0ab2cb29867 req-16171f63-a4bf-4087-9497-e879c5234d58 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state active and task_state None.
Apr 13 15:14:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:15 user nova-compute[71507]: INFO nova.compute.manager [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Unrescuing
Apr 13 15:14:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:14:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquired lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:14:15 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:14:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updating instance_info_cache with network_info: [{"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Releasing lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'flavor' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-unplugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-unplugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:16 user nova-compute[71507]: WARNING nova.compute.manager [req-9323015b-4cac-4509-a21a-81ccdf34bd33 req-099375ca-fd26-41dc-999d-4f2f6af7e502 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-unplugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:14:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:17 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Instance destroyed successfully.
Apr 13 15:14:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:18 user nova-compute[71507]: WARNING nova.compute.manager [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:14:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:18 user nova-compute[71507]: WARNING nova.compute.manager [req-a28c48c3-6ea5-47d0-b52c-226b177deb16 req-bce962b2-c6e6-4bbe-94ee-da4608a7aeaf service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for 0a0a9548-9e57-4007-bafb-d418a4433473 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398860.704295, 0a0a9548-9e57-4007-bafb-d418a4433473 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:14:20 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] VM Resumed (Lifecycle Event)
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a2318b3d-79b9-4968-85f0-97dadc325135 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:14:20 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398860.7081654, 0a0a9548-9e57-4007-bafb-d418a4433473 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:14:20 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] VM Started (Lifecycle Event)
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:20 user nova-compute[71507]: WARNING nova.compute.manager [req-21b87001-871c-4580-81e6-4208dc6b3f04 req-2302ee6d-47a9-4644-a7ed-0de342299f58 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state active and task_state None.
Apr 13 15:14:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:14:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:14:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:14:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:14:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:14:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:14:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:26 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:14:26 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:14:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7378MB free_disk=26.12054443359375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:14:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 654608ee-5897-429a-b19c-6845d4e84818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 179b6945-589d-402c-a89e-6b8d68725211 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 241d70af-85a4-4798-9acd-e6431ca5c350 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing instance network info cache due to event network-changed-b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] Acquiring lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] Acquired lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG nova.network.neutron [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Refreshing network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:28 user nova-compute[71507]: INFO nova.compute.manager [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Terminating instance
Apr 13 15:14:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-unplugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] No waiting events found dispatching network-vif-unplugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-12285ff3-7602-40cb-8186-a836adc9d492 req-7917dc20-fcc2-4525-b975-db20cc57a7d0 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-unplugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.network.neutron [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updated VIF entry in instance network info cache for port b6a42460-29f0-496d-a7ba-d7ae2259f317. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.network.neutron [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating instance_info_cache with network_info: [{"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4db5bb64-f642-4871-92aa-e1440b307572 req-dfd2ac9f-353e-4c9b-96c4-5ed047ee0ce5 service nova] Releasing lock "refresh_cache-179b6945-589d-402c-a89e-6b8d68725211" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:14:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Instance destroyed successfully.
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lazy-loading 'resources' on Instance uuid 179b6945-589d-402c-a89e-6b8d68725211 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-411290166',display_name='tempest-TestShelveInstance-server-411290166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-411290166',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMiNMWIbugIqPibluDtkgkNEHAz0dy1D5iz8h+LzuOQnT0xmd5kr4yKVwXHq5lSKq5W4WLRwRbSWAGEOzySrgPdrDDGPAIFjjmc2lQ7zaPxRPWJoiG7d4rgdJ1tvZwk/g==',key_name='tempest-TestShelveInstance-771163491',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7227559570b54e92be19d25938523b49',ramdisk_id='',reservation_id='r-btkem4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1754998277',owner_user_name='tempest-TestShelveInstance-1754998277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:12:53Z,user_data=None,user_id='2fc0cce3df7540078438186f46ca4621',uuid=179b6945-589d-402c-a89e-6b8d68725211,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converting VIF {"id": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "address": "fa:16:3e:be:8a:4c", "network": {"id": "a191c30d-997a-46b8-bcc2-78a766c1bae2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1527793655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7227559570b54e92be19d25938523b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6a42460-29", "ovs_interfaceid": "b6a42460-29f0-496d-a7ba-d7ae2259f317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_vif [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6a42460-29, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:14:29 user nova-compute[71507]: INFO os_vif [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:8a:4c,bridge_name='br-int',has_traffic_filtering=True,id=b6a42460-29f0-496d-a7ba-d7ae2259f317,network=Network(a191c30d-997a-46b8-bcc2-78a766c1bae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6a42460-29')
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrFEgzON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:14:29 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb39eb4f-228f-4594-bd41-fec04cf3d722]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:14:29 user nova-compute[71507]: No targets found.
Apr 13 15:14:29 user nova-compute[71507]: iSNS:
Apr 13 15:14:29 user nova-compute[71507]: No targets found.
Apr 13 15:14:29 user nova-compute[71507]: STATIC:
Apr 13 15:14:29 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b
Apr 13 15:14:29 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:29 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:29 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b
Apr 13 15:14:29 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:29 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:29 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:14:29 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:29 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:29 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8
Apr 13 15:14:29 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:29 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:29 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0
Apr 13 15:14:29 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:29 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:29 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961
Apr 13 15:14:29 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:29 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:29 user nova-compute[71507]: FIRMWARE:
Apr 13 15:14:29 user nova-compute[71507]: No targets found.
Apr 13 15:14:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:14:29 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:14:29 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda2f5ac-1abd-4198-8158-c88b2a064acd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8830c8-03bd-4f29-8f8d-3f86b4ae8c66]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:14:29 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab257b8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961'): ({'sdd'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Removing single pathed devices sdd {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a216006-9fbc-4212-ac88-dbe03916a8bd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5e2a4a-7611-4ad2-a160-66e6fff08d3a]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Flushing IO for device /dev/sdd {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14883f8-7217-4683-a67a-7692ab5707e0]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b1de5c-45d7-456e-ad03-155069bb32a7]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eee4478-7f95-4f74-8dfe-053c6e3859c7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f288836f-dc16-45e7-b951-f00a169e324c]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260]
Apr 13 15:14:29 user nova-compute[71507]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961, portal: 172.16.0.220,3260] successful.
Apr 13 15:14:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddca559-4699-4c09-aca9-db61ea2e7961 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d4002d-d401-438a-8688-a2eaea835578]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] <== disconnect_volume: return (331ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:14:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Deleting instance files /opt/stack/data/nova/instances/179b6945-589d-402c-a89e-6b8d68725211_del
Apr 13 15:14:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Deletion of /opt/stack/data/nova/instances/179b6945-589d-402c-a89e-6b8d68725211_del complete
Apr 13 15:14:29 user nova-compute[71507]: INFO nova.compute.manager [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 13 15:14:29 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:14:29 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:14:30 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:14:30 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Took 0.53 seconds to deallocate network for instance.
Apr 13 15:14:30 user nova-compute[71507]: DEBUG nova.compute.manager [req-5741920c-464b-4d7b-8059-34e3a0e19a7d req-5525c188-d34a-4d27-af4c-16e1b264ea85 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-deleted-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:30 user nova-compute[71507]: DEBUG nova.compute.manager [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] Acquiring lock "179b6945-589d-402c-a89e-6b8d68725211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] Lock "179b6945-589d-402c-a89e-6b8d68725211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:30 user nova-compute[71507]: DEBUG nova.compute.manager [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] No waiting events found dispatching network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:30 user nova-compute[71507]: WARNING nova.compute.manager [req-a804b34e-d38c-49f8-b06b-0eb346dd1ece req-c5944543-6851-488d-84fc-91a5a89393a6 service nova] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Received unexpected event network-vif-plugged-b6a42460-29f0-496d-a7ba-d7ae2259f317 for instance with vm_state active and task_state deleting.
Apr 13 15:14:31 user nova-compute[71507]: INFO nova.compute.manager [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Took 0.97 seconds to detach 1 volumes for instance.
Apr 13 15:14:31 user nova-compute[71507]: DEBUG nova.compute.manager [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Deleting volume: 0ddca559-4699-4c09-aca9-db61ea2e7961 {{(pid=71507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 15:14:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:31 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:14:31 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:14:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:32 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Deleted allocations for instance 179b6945-589d-402c-a89e-6b8d68725211
Apr 13 15:14:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4860657c-543e-4bd6-84c4-d5172de0584f tempest-TestShelveInstance-1754998277 tempest-TestShelveInstance-1754998277-project-member] Lock "179b6945-589d-402c-a89e-6b8d68725211" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.558s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-changed-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Refreshing instance network info cache due to event network-changed-84611f06-d6ca-49e1-afe7-7723921e62dc. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] Acquiring lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] Acquired lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Refreshing network info cache for port 84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updated VIF entry in instance network info cache for port 84611f06-d6ca-49e1-afe7-7723921e62dc. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updating instance_info_cache with network_info: [{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e6c5db80-7593-4db4-95f7-4eb24a31576f req-4f4a068f-af6f-45eb-a087-76172b8a93b1 service nova] Releasing lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-changed-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing instance network info cache due to event network-changed-5eac5fa3-8589-47e1-8c93-bb65b7b095a1. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] Acquiring lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] Acquired lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:14:36 user nova-compute[71507]: DEBUG nova.network.neutron [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Refreshing network info cache for port 5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updated VIF entry in instance network info cache for port 5eac5fa3-8589-47e1-8c93-bb65b7b095a1. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [{"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4dcdfcd8-da71-4e3a-ba71-bb728aa0031d req-5cf0cb1d-5134-44b4-9f91-a2ff6b64a04a service nova] Releasing lock "refresh_cache-241d70af-85a4-4798-9acd-e6431ca5c350" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG nova.objects.instance [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:37 user nova-compute[71507]: INFO nova.compute.manager [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Attaching volume 833def22-5680-4c24-9368-2130eefccdfc to /dev/vdb
Apr 13 15:14:37 user nova-compute[71507]: DEBUG os_brick.utils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cbbb47-639c-443d-899a-108a062545bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc35da4d-c7b2-48db-85da-40005b7882af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade0a539-ddf2-41b6-902a-1d47e499e1e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3f4769-61c8-4fec-b78a-cfb5a57f7ca6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:14:38 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdfd31c-0f3f-4044-9331-0859cb22f9a7]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG os_brick.utils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updating existing volume attachment record: 66c2640f-a776-48c5-ac32-3c4022e16914 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "241d70af-85a4-4798-9acd-e6431ca5c350" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:38 user nova-compute[71507]: INFO nova.compute.manager [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Terminating instance
Apr 13 15:14:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-unplugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-0c433c05-596d-4e67-84ce-6309469e3153 req-32da1046-5c19-416b-886f-34ea91277017 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:14:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG nova.compute.manager [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG nova.compute.manager [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-unplugged-26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG nova.compute.manager [req-b6454007-6f04-47ea-b9d2-95951a8b29c9 req-8c686e57-67c2-429b-a6f1-a18333e616ee service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-26419cbf-54b6-47ab-a068-356727e4a6ca for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG nova.compute.manager [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG nova.compute.manager [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-unplugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG nova.compute.manager [req-7c9d36c7-99e5-4e8f-b135-8f17fe3751ed req-7fafd567-f8e1-4fba-89d6-c64c5bfee28f service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Instance destroyed successfully.
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.objects.instance [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lazy-loading 'resources' on Instance uuid 241d70af-85a4-4798-9acd-e6431ca5c350 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:3f:bc,bridge_name='br-int',has_traffic_filtering=True,id=5eac5fa3-8589-47e1-8c93-bb65b7b095a1,network=Network(c6073972-8aae-444d-95f2-fbc4e4a63d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eac5fa3-85') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:3f:bc,bridge_name='br-int',has_traffic_filtering=True,id=5eac5fa3-8589-47e1-8c93-bb65b7b095a1,network=Network(c6073972-8aae-444d-95f2-fbc4e4a63d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eac5fa3-85') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5eac5fa3-85, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: INFO os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:3f:bc,bridge_name='br-int',has_traffic_filtering=True,id=5eac5fa3-8589-47e1-8c93-bb65b7b095a1,network=Network(c6073972-8aae-444d-95f2-fbc4e4a63d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eac5fa3-85')
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:e2,bridge_name='br-int',has_traffic_filtering=True,id=458d18a0-cd93-4e5f-8d97-842f7d0dc73d,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458d18a0-cd') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:e2,bridge_name='br-int',has_traffic_filtering=True,id=458d18a0-cd93-4e5f-8d97-842f7d0dc73d,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458d18a0-cd') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap458d18a0-cd, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: INFO os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e4:e2,bridge_name='br-int',has_traffic_filtering=True,id=458d18a0-cd93-4e5f-8d97-842f7d0dc73d,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458d18a0-cd')
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:7b:cb,bridge_name='br-int',has_traffic_filtering=True,id=26419cbf-54b6-47ab-a068-356727e4a6ca,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26419cbf-54') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:7b:cb,bridge_name='br-int',has_traffic_filtering=True,id=26419cbf-54b6-47ab-a068-356727e4a6ca,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26419cbf-54') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26419cbf-54, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: INFO os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:7b:cb,bridge_name='br-int',has_traffic_filtering=True,id=26419cbf-54b6-47ab-a068-356727e4a6ca,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26419cbf-54')
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:39,bridge_name='br-int',has_traffic_filtering=True,id=b572fcf6-8374-49f4-b760-dc845d794668,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572fcf6-83') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:39,bridge_name='br-int',has_traffic_filtering=True,id=b572fcf6-8374-49f4-b760-dc845d794668,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572fcf6-83') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb572fcf6-83, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: INFO os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:df:39,bridge_name='br-int',has_traffic_filtering=True,id=b572fcf6-8374-49f4-b760-dc845d794668,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572fcf6-83')
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b6:c9,bridge_name='br-int',has_traffic_filtering=True,id=dda3844e-0bda-47ff-8de6-25b9cde47976,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda3844e-0b') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b6:c9,bridge_name='br-int',has_traffic_filtering=True,id=dda3844e-0bda-47ff-8de6-25b9cde47976,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda3844e-0b') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdda3844e-0b, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: INFO os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b6:c9,bridge_name='br-int',has_traffic_filtering=True,id=dda3844e-0bda-47ff-8de6-25b9cde47976,network=Network(86a8c3fe-5a23-4245-aa67-ac25b3164369),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda3844e-0b')
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "address": "fa:16:3e:00:15:df", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f28318-b2", "ovs_interfaceid": "c6f28318-b210-4a1d-8954-d7e8dc4b19e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:15:df,bridge_name='br-int',has_traffic_filtering=True,id=c6f28318-b210-4a1d-8954-d7e8dc4b19e2,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f28318-b2') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:15:df,bridge_name='br-int',has_traffic_filtering=True,id=c6f28318-b210-4a1d-8954-d7e8dc4b19e2,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f28318-b2') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6f28318-b2, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: INFO os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:15:df,bridge_name='br-int',has_traffic_filtering=True,id=c6f28318-b210-4a1d-8954-d7e8dc4b19e2,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f28318-b2')
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T15:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-286688180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-286688180',id=19,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2qobe+p4YbBIqZxKCuME3Wcdf4j4mAdaI1ar0+BErpZi6rNbxRIDhXzR1EAcHld8/OFcBwGPGuzLYb2TdezIPNDhCEhkR/IL0Vrzf9Nbm1cuVRIykSyiVv52QJPW9tFg==',key_name='tempest-keypair-251315304',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac94a736e99f4f978f043f2b1b929284',ramdisk_id='',reservation_id='r-j7lryhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-379148639',owner_user_name='tempest-TaggedBootDevicesTest_v242-379148639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc549309fa74c0a8eb2f44e5959ce92',uuid=241d70af-85a4-4798-9acd-e6431ca5c350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converting VIF {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0f04a8c8-b74c-4ecf-9a72-0628b196102c,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f04a8c8-b7') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0f04a8c8-b74c-4ecf-9a72-0628b196102c,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f04a8c8-b7') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f04a8c8-b7, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:40 user nova-compute[71507]: INFO os_vif [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0f04a8c8-b74c-4ecf-9a72-0628b196102c,network=Network(96e744af-ef9d-42cf-ac74-b64e75ccbaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f04a8c8-b7')
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHxyUAuX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:14:40 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94622d7-f184-4cce-ad82-b3eccbbe5d22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:14:40 user nova-compute[71507]: No targets found.
Apr 13 15:14:40 user nova-compute[71507]: iSNS:
Apr 13 15:14:40 user nova-compute[71507]: No targets found.
Apr 13 15:14:40 user nova-compute[71507]: STATIC:
Apr 13 15:14:40 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b
Apr 13 15:14:40 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:40 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:40 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b
Apr 13 15:14:40 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:40 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:40 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:14:40 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:40 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:40 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8
Apr 13 15:14:40 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:40 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:40 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0
Apr 13 15:14:40 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:40 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:40 user nova-compute[71507]: FIRMWARE:
Apr 13 15:14:40 user nova-compute[71507]: No targets found.
Apr 13 15:14:40 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:14:40 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:14:40 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5ff96b-cb04-4854-8fd9-4894734300fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bacc849-6095-4ead-b06a-6d2143849626]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:40 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:14:40 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:14:40 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:14:40 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:40 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:40 user nova-compute[71507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b (non-flash)
Apr 13 15:14:40 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:14:40 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:14:40 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:40 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab14156dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b'): ({'sde'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Removing single pathed devices sde {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6718bc01-cc17-4971-99b7-ce411d62dc8f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaf9951-40c9-4465-9e4e-cd18402573ad]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Flushing IO for device /dev/sde {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5c57a0-ccae-464e-b6de-a4076df2bc79]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[801cffe6-594b-458d-a9e7-325eb9b5571d]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dbb7e5-bba1-4036-b6f1-fbc61db7f918]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:40 user nova-compute[71507]: WARNING nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 for instance with vm_state active and task_state deleting.
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-unplugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:40 user nova-compute[71507]: WARNING nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-458d18a0-cd93-4e5f-8d97-842f7d0dc73d for instance with vm_state active and task_state deleting.
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-unplugged-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-b572fcf6-8374-49f4-b760-dc845d794668 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:40 user nova-compute[71507]: WARNING nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-b572fcf6-8374-49f4-b760-dc845d794668 for instance with vm_state active and task_state deleting.
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-unplugged-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-dda3844e-0bda-47ff-8de6-25b9cde47976 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:40 user nova-compute[71507]: WARNING nova.compute.manager [req-a0036d25-258c-499b-99e8-43061eebb708 req-c64610d5-5d78-472d-bc44-c15b7cd3e335 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-dda3844e-0bda-47ff-8de6-25b9cde47976 for instance with vm_state active and task_state deleting.
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a8cdb8-643b-4de3-8f3e-c3731060106f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:40 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b, portal: 172.16.0.220,3260]
Apr 13 15:14:40 user nova-compute[71507]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b, portal: 172.16.0.220,3260] successful.
Apr 13 15:14:40 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15da0023-8e48-431d-a2f0-2813a183bc2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd2f134-8b93-4b21-89b5-bb56ee81d08a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] <== disconnect_volume: return (360ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PysJCTop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:14:41 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d25a49c-8063-4aee-9d89-b8e4dafc7b19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:14:41 user nova-compute[71507]: No targets found.
Apr 13 15:14:41 user nova-compute[71507]: iSNS:
Apr 13 15:14:41 user nova-compute[71507]: No targets found.
Apr 13 15:14:41 user nova-compute[71507]: STATIC:
Apr 13 15:14:41 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b
Apr 13 15:14:41 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:41 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:41 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:14:41 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:41 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:41 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8
Apr 13 15:14:41 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:41 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:41 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0
Apr 13 15:14:41 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:41 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:41 user nova-compute[71507]: FIRMWARE:
Apr 13 15:14:41 user nova-compute[71507]: No targets found.
Apr 13 15:14:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:14:41 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:14:41 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c24a90f-ee45-4978-91ae-363ba9a20073]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51ae540-787f-4ea3-a47a-957d50a7ae93]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c335000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b'): ({'sdf'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Removing single pathed devices sdf {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31dd3f0-9681-42ff-a889-bbe388d57c86]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8449ace-c221-4344-98ed-35167a65ac00]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Flushing IO for device /dev/sdf {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58752a4-4b16-4bc1-9645-ba83d071ddc7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b3a724-7640-406a-b325-e5a87a3ac1b2]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dc130d-a9f8-454c-b9f7-e7d4799d6690]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-26419cbf-54b6-47ab-a068-356727e4a6ca {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:41 user nova-compute[71507]: WARNING nova.compute.manager [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-26419cbf-54b6-47ab-a068-356727e4a6ca for instance with vm_state active and task_state deleting.
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-unplugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-unplugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:41 user nova-compute[71507]: WARNING nova.compute.manager [req-43c1ecc5-e422-483f-b466-4e02a4a63be8 req-9fec8367-4769-4e3e-b7cf-6cc4490b95ac service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 for instance with vm_state active and task_state deleting.
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76c3b44-2bdb-419c-9200-efe37da6d3a7]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b, portal: 172.16.0.220,3260]
Apr 13 15:14:41 user nova-compute[71507]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b, portal: 172.16.0.220,3260] successful.
Apr 13 15:14:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66aa0088-0ff5-4f9a-ad2c-5917811cd32b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5fdc52-f968-4ea3-9f37-847a3fe17477]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] <== disconnect_volume: return (293ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxJTVBuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:14:41 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76b5639-3d0e-414a-8cfd-4fbdd698f4a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:14:41 user nova-compute[71507]: No targets found.
Apr 13 15:14:41 user nova-compute[71507]: iSNS:
Apr 13 15:14:41 user nova-compute[71507]: No targets found.
Apr 13 15:14:41 user nova-compute[71507]: STATIC:
Apr 13 15:14:41 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:14:41 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:41 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:41 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8
Apr 13 15:14:41 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:41 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:41 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0
Apr 13 15:14:41 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:14:41 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:14:41 user nova-compute[71507]: FIRMWARE:
Apr 13 15:14:41 user nova-compute[71507]: No targets found.
Apr 13 15:14:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:14:41 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:14:41 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db04203f-658a-4dcf-9d13-e08402cafbc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce44923-3a14-4567-a7f5-d4809eaf9361]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab28aa77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8'): ({'sdg'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Removing single pathed devices sdg {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c22df5-b5c0-49a7-bb7c-a30e66e2af74]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8d2986-5fb9-4236-8080-b2272d45e98b]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Flushing IO for device /dev/sdg {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee185a2-1a3e-4db1-bdea-57cd2bf06469]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1040accb-46af-4ce1-8359-a3f659c9f9ee]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] SCSI volumes sdg have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[105d1243-3b24-4e99-8f94-241cd0b6a16a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-plugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] Acquiring lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] Lock "241d70af-85a4-4798-9acd-e6431ca5c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] No waiting events found dispatching network-vif-plugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:41 user nova-compute[71507]: WARNING nova.compute.manager [req-89fe6cd0-8261-422c-953a-6fdadfcad963 req-f7765923-be5c-4ec4-a955-486878b627d4 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received unexpected event network-vif-plugged-0f04a8c8-b74c-4ecf-9a72-0628b196102c for instance with vm_state active and task_state deleting.
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf4c68-bb64-4e5d-baac-7c021420246d]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8, portal: 172.16.0.220,3260]
Apr 13 15:14:41 user nova-compute[71507]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8, portal: 172.16.0.220,3260] successful.
Apr 13 15:14:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81beedc0-0e22-4d24-9f34-375b2890a9f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bba2a0d-bd72-4fde-b59a-7e4affddd6bc]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] <== disconnect_volume: return (320ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:14:41 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Deleting instance files /opt/stack/data/nova/instances/241d70af-85a4-4798-9acd-e6431ca5c350_del
Apr 13 15:14:41 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Deletion of /opt/stack/data/nova/instances/241d70af-85a4-4798-9acd-e6431ca5c350_del complete
Apr 13 15:14:41 user nova-compute[71507]: INFO nova.compute.manager [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Took 3.17 seconds to destroy the instance on the hypervisor.
Apr 13 15:14:41 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:14:41 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:14:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIFDdulb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:14:43 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:14:43 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:14:43 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d96917f-a4d9-4c96-a6fa-66589cb87001]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:14:43 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c58dda-9997-43bc-a676-5e955c0a4fa4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc] added
Apr 13 15:14:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30b91cb-9e1e-4143-849b-8ef5c782e9b4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa67642-46c3-42ab-a956-0a91b57a75b8]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIFDdulb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIFDdulb" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad29de63-3e5c-4bfa-b48d-af9c564c28ba]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIFDdulb'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a692034-bcc7-4034-8b03-b2f6949d43d2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[401bdb44-2d21-4ae5-b5ce-2b81a989f02b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:43 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:43 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c731685a-4d1b-4c3e-b54c-a440d117c632]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260]
Apr 13 15:14:43 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260] successful.
Apr 13 15:14:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d749b082-4faa-4b3d-8512-4923918dcd18]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b48b8b-494f-4e0c-8eff-f9cddfb0b26e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:43 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:43 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:14:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:14:43 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:14:43 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:14:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[117d6085-0227-483f-bf3d-0be1988b4282]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:14:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIFDdulb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-deleted-c6f28318-b210-4a1d-8954-d7e8dc4b19e2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:44 user nova-compute[71507]: INFO nova.compute.manager [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Neutron deleted interface c6f28318-b210-4a1d-8954-d7e8dc4b19e2; detaching it from the instance and deleting it from the info cache
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.network.neutron [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [{"id": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "address": "fa:16:3e:f1:3f:bc", "network": {"id": "c6073972-8aae-444d-95f2-fbc4e4a63d06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-921564046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eac5fa3-85", "ovs_interfaceid": "5eac5fa3-8589-47e1-8c93-bb65b7b095a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "address": "fa:16:3e:0d:e4:e2", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458d18a0-cd", "ovs_interfaceid": "458d18a0-cd93-4e5f-8d97-842f7d0dc73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26419cbf-54b6-47ab-a068-356727e4a6ca", "address": "fa:16:3e:5f:7b:cb", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26419cbf-54", "ovs_interfaceid": "26419cbf-54b6-47ab-a068-356727e4a6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b572fcf6-8374-49f4-b760-dc845d794668", "address": "fa:16:3e:2f:df:39", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572fcf6-83", "ovs_interfaceid": "b572fcf6-8374-49f4-b760-dc845d794668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda3844e-0bda-47ff-8de6-25b9cde47976", "address": "fa:16:3e:06:b6:c9", "network": {"id": "86a8c3fe-5a23-4245-aa67-ac25b3164369", "bridge": "br-int", "label": "tempest-device-tagging-net1-596007287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda3844e-0b", "ovs_interfaceid": "dda3844e-0bda-47ff-8de6-25b9cde47976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "address": "fa:16:3e:fb:6e:a9", "network": {"id": "96e744af-ef9d-42cf-ac74-b64e75ccbaee", "bridge": "br-int", "label": "tempest-device-tagging-net2-5201106", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac94a736e99f4f978f043f2b1b929284", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f04a8c8-b7", "ovs_interfaceid": "0f04a8c8-b74c-4ecf-9a72-0628b196102c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-e299b543-d1db-47b0-8221-f7509ebb5616 req-dcc6b756-4215-4b17-9379-0f2679807c11 service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Detach interface failed, port_id=c6f28318-b210-4a1d-8954-d7e8dc4b19e2, reason: Instance 241d70af-85a4-4798-9acd-e6431ca5c350 could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23033306662636264', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033306662636264', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.objects.instance [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:14:44 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:14:44 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:14:44 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:14:44 user nova-compute[71507]:   <serial>833def22-5680-4c24-9368-2130eefccdfc</serial>
Apr 13 15:14:44 user nova-compute[71507]: </disk>
Apr 13 15:14:44 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398869.3756585, 179b6945-589d-402c-a89e-6b8d68725211 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:14:44 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 179b6945-589d-402c-a89e-6b8d68725211] VM Stopped (Lifecycle Event)
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-295eb610-897f-4e9a-a2f4-f093bfc60a3c None None] [instance: 179b6945-589d-402c-a89e-6b8d68725211] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No VIF found with MAC fa:16:3e:a3:4a:01, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:14:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1a190b2b-e18e-47b1-b292-23c37e3c5730 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.011s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71507) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:45 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:14:46 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Took 4.29 seconds to deallocate network for instance.
Apr 13 15:14:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-deleted-5eac5fa3-8589-47e1-8c93-bb65b7b095a1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-deleted-0f04a8c8-b74c-4ecf-9a72-0628b196102c {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-deleted-b572fcf6-8374-49f4-b760-dc845d794668 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-cc8c2768-0b32-407e-958c-93c913eddf65 req-89193535-0129-4b32-ba6a-6c4a4bd1e51f service nova] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Received event network-vif-deleted-dda3844e-0bda-47ff-8de6-25b9cde47976 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-unplugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-unplugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:46 user nova-compute[71507]: WARNING nova.compute.manager [req-f2f87653-1f87-4a3a-b66a-927befc96ce7 req-a3529cdd-b9e9-44a6-b20f-1f20e96f79bd service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-unplugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state active and task_state powering-off.
Apr 13 15:14:46 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance destroyed successfully.
Apr 13 15:14:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9147be38-073b-4582-8597-01d8276b248e tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.868s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:48 user nova-compute[71507]: WARNING nova.compute.manager [req-67baead5-3751-4c3c-8711-a35db6973b27 req-9edf55bb-2890-4280-8f21-50f9f90e65ae service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state stopped and task_state None.
Apr 13 15:14:48 user nova-compute[71507]: INFO nova.compute.manager [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Took 2.46 seconds to detach 3 volumes for instance.
Apr 13 15:14:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:48 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:14:48 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:14:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:48 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Deleted allocations for instance 241d70af-85a4-4798-9acd-e6431ca5c350
Apr 13 15:14:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-620f3606-d9a0-49bb-b536-2463eaa28134 tempest-TaggedBootDevicesTest_v242-379148639 tempest-TaggedBootDevicesTest_v242-379148639-project-member] Lock "241d70af-85a4-4798-9acd-e6431ca5c350" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.498s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:49 user nova-compute[71507]: INFO nova.compute.manager [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Terminating instance
Apr 13 15:14:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-unplugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Acquiring lock "654608ee-5897-429a-b19c-6845d4e84818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] Lock "654608ee-5897-429a-b19c-6845d4e84818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] No waiting events found dispatching network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:14:50 user nova-compute[71507]: WARNING nova.compute.manager [req-49f5b0a8-ae0e-4f6b-bd38-c22149be4f21 req-1f53d2bc-146a-49c7-8770-331e3a45d9d8 service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received unexpected event network-vif-plugged-a534f901-d679-4443-bf28-aaba09bf631f for instance with vm_state active and task_state deleting.
Apr 13 15:14:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:50 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Instance destroyed successfully.
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.objects.instance [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lazy-loading 'resources' on Instance uuid 654608ee-5897-429a-b19c-6845d4e84818 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1909171132',display_name='tempest-ServerStableDeviceRescueTest-server-1909171132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1909171132',id=5,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6aSZKMD7DZRWnRyQAYKNVncY9MliP5yy+hr0mgok5IZOsUvvcpOVyIYwqoPxDEzOUN1HvhtDQMVs5WOR8xHMOt96WLfesTfqwvy1g4TGHpkWUPIHKMkqgOoitvtlLAkg==',key_name='tempest-keypair-135051856',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:11:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5acb52755c74d118d012e38feed7237',ramdisk_id='',reservation_id='r-il3m75mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-147407416',owner_user_name='tempest-ServerStableDeviceRescueTest-147407416-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b30a69b780664742aed58bd9a578e873',uuid=654608ee-5897-429a-b19c-6845d4e84818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Converting VIF {"id": "a534f901-d679-4443-bf28-aaba09bf631f", "address": "fa:16:3e:2a:ca:62", "network": {"id": "1cdb762d-7c09-4d16-bd83-31a75edb8a9c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412331868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5acb52755c74d118d012e38feed7237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa534f901-d6", "ovs_interfaceid": "a534f901-d679-4443-bf28-aaba09bf631f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:62,bridge_name='br-int',has_traffic_filtering=True,id=a534f901-d679-4443-bf28-aaba09bf631f,network=Network(1cdb762d-7c09-4d16-bd83-31a75edb8a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa534f901-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG os_vif [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:62,bridge_name='br-int',has_traffic_filtering=True,id=a534f901-d679-4443-bf28-aaba09bf631f,network=Network(1cdb762d-7c09-4d16-bd83-31a75edb8a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa534f901-d6') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa534f901-d6, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:50 user nova-compute[71507]: INFO os_vif [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:62,bridge_name='br-int',has_traffic_filtering=True,id=a534f901-d679-4443-bf28-aaba09bf631f,network=Network(1cdb762d-7c09-4d16-bd83-31a75edb8a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa534f901-d6')
Apr 13 15:14:50 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Deleting instance files /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818_del
Apr 13 15:14:50 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Deletion of /opt/stack/data/nova/instances/654608ee-5897-429a-b19c-6845d4e84818_del complete
Apr 13 15:14:50 user nova-compute[71507]: INFO nova.compute.manager [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 15:14:50 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:14:50 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:14:51 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:14:51 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Took 0.78 seconds to deallocate network for instance.
Apr 13 15:14:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-4fd6d627-ab2b-4051-9697-c61fea7a4052 req-d7266237-e2e9-4c0f-949d-8d100328733e service nova] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Received event network-vif-deleted-a534f901-d679-4443-bf28-aaba09bf631f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:14:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:14:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:14:51 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:14:51 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:14:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:51 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Deleted allocations for instance 654608ee-5897-429a-b19c-6845d4e84818
Apr 13 15:14:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-46c468f9-5a9f-492b-9b9c-d4c983269868 tempest-ServerStableDeviceRescueTest-147407416 tempest-ServerStableDeviceRescueTest-147407416-project-member] Lock "654608ee-5897-429a-b19c-6845d4e84818" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:14:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:14:55 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398880.2654626, 241d70af-85a4-4798-9acd-e6431ca5c350 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:14:55 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] VM Stopped (Lifecycle Event)
Apr 13 15:14:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5eb864fb-7857-4fb4-884e-9abba41b3009 None None] [instance: 241d70af-85a4-4798-9acd-e6431ca5c350] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:14:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:15:01 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398886.4589965, 1aa74d14-db6f-41f5-b8af-32da312209d3 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:15:01 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] VM Stopped (Lifecycle Event)
Apr 13 15:15:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-93a0adb1-8eda-4096-a835-a9c16c913e6b None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:15:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-93a0adb1-8eda-4096-a835-a9c16c913e6b None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:15:05 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398890.4357824, 654608ee-5897-429a-b19c-6845d4e84818 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:15:05 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 654608ee-5897-429a-b19c-6845d4e84818] VM Stopped (Lifecycle Event)
Apr 13 15:15:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-48326319-c213-4b23-a39b-84c71d8e1efe None None] [instance: 654608ee-5897-429a-b19c-6845d4e84818] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:15:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:15:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:15:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:15:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:15:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:15:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing instance network info cache due to event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:15:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] Acquiring lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:15:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] Acquired lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:15:09 user nova-compute[71507]: DEBUG nova.network.neutron [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:15:09 user nova-compute[71507]: DEBUG nova.network.neutron [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updated VIF entry in instance network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:15:09 user nova-compute[71507]: DEBUG nova.network.neutron [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updating instance_info_cache with network_info: [{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:15:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d45dd36b-5fe8-441d-bfff-6231b232a4fc req-fe215183-dbce-4e97-834f-1a3629c42472 service nova] Releasing lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing instance network info cache due to event network-changed-f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] Acquiring lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] Acquired lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG nova.network.neutron [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Refreshing network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:10 user nova-compute[71507]: INFO nova.compute.manager [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Detaching volume f29176ab-5dde-4b23-9e8d-4aee8409dcb0
Apr 13 15:15:10 user nova-compute[71507]: INFO nova.virt.block_device [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Attempting to driver detach volume f29176ab-5dde-4b23-9e8d-4aee8409dcb0 from mountpoint /dev/vdb
Apr 13 15:15:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Attempting to detach device vdb from instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:15:10 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:15:10 user nova-compute[71507]:   <source dev="/dev/sdh"/>
Apr 13 15:15:10 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:15:10 user nova-compute[71507]:   <serial>f29176ab-5dde-4b23-9e8d-4aee8409dcb0</serial>
Apr 13 15:15:10 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 15:15:10 user nova-compute[71507]: </disk>
Apr 13 15:15:10 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:15:10 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully detached device vdb from instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff from the persistent domain config.
Apr 13 15:15:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:15:10 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:15:10 user nova-compute[71507]:   <source dev="/dev/sdh"/>
Apr 13 15:15:10 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:15:10 user nova-compute[71507]:   <serial>f29176ab-5dde-4b23-9e8d-4aee8409dcb0</serial>
Apr 13 15:15:10 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 15:15:10 user nova-compute[71507]: </disk>
Apr 13 15:15:10 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG nova.network.neutron [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updated VIF entry in instance network info cache for port f7bf7380-3c36-4404-8bba-0f64c3fc59a3. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG nova.network.neutron [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updating instance_info_cache with network_info: [{"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:15:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ba053b33-31cf-4c36-9a8d-a42a6c7afd82 req-23dbd749-f3a0-40dc-9914-e1fda6385db1 service nova] Releasing lock "refresh_cache-05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681398911.258225, 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:15:11 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully detached device vdb from instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff from the live domain config.
Apr 13 15:15:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVExlJpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:15:11 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d45c8-1137-44d5-8ac1-0351baa90ac3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:15:11 user nova-compute[71507]: No targets found.
Apr 13 15:15:11 user nova-compute[71507]: iSNS:
Apr 13 15:15:11 user nova-compute[71507]: No targets found.
Apr 13 15:15:11 user nova-compute[71507]: STATIC:
Apr 13 15:15:11 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc
Apr 13 15:15:11 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:15:11 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:15:11 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:15:11 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:15:11 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:15:11 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0
Apr 13 15:15:11 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:15:11 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:15:11 user nova-compute[71507]: FIRMWARE:
Apr 13 15:15:11 user nova-compute[71507]: No targets found.
Apr 13 15:15:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:15:11 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:15:11 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[400c69db-880c-40f6-994c-fbf336cfd8ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff62e5d3-3e4d-467b-b67c-608dc540fd53]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:11 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:15:11 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:11 user nova-compute[71507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 (non-flash)
Apr 13 15:15:11 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c278790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0'): ({'sdh'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Removing single pathed devices sdh {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46fea06-bc52-48af-9265-05ef2c4071b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92ec755-c969-449a-ac34-4ae660a9c78c]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flushing IO for device /dev/sdh {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe67a2d9-7d93-4b23-ac6c-ff21dd8b9e50]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded69590-94f2-4f17-a3c8-e59c5137026f]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] SCSI volumes sdh have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c4b34c-659c-4318-9b8a-4125c0cd02d3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[080c6d3c-0adc-4b1e-9227-46636af2d5e7]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260]
Apr 13 15:15:11 user nova-compute[71507]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0, portal: 172.16.0.220,3260] successful.
Apr 13 15:15:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f29176ab-5dde-4b23-9e8d-4aee8409dcb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1832d8b4-4087-4bcb-9533-922c148a62ce]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] <== disconnect_volume: return (329ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:15:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:15:12 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'flavor' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a3fd570b-4a19-4f73-aae4-11cc4a7ad10b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.755s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:18 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:15:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:15:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:15:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:15:18 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:15:18 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updating instance_info_cache with network_info: [{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:15:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:15:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:15:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:15:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:23 user nova-compute[71507]: INFO nova.compute.manager [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Terminating instance
Apr 13 15:15:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received event network-vif-unplugged-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] Acquiring lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] No waiting events found dispatching network-vif-unplugged-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:15:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-4bec5501-54f5-4bb0-a98f-536dbfcfe956 req-cb8d426b-ee36-4fbe-aa4a-feb5d8f8eb53 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received event network-vif-unplugged-ec148848-53a7-4ed8-8105-7d95722393bc for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:15:24 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Instance destroyed successfully.
Apr 13 15:15:24 user nova-compute[71507]: DEBUG nova.objects.instance [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lazy-loading 'resources' on Instance uuid 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1355034600',display_name='tempest-VolumesActionsTest-instance-1355034600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1355034600',id=20,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:13:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c0cae04ab4b4157a7ef786d165789a6',ramdisk_id='',reservation_id='r-6qxw2tre',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-119634704',owner_user_name='tempest-VolumesActionsTest-119634704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:40Z,user_data=None,user_id='3bdc942f33ca46c08bb143ed2efeb458',uuid=9bad86ad-6d5b-45f1-bcd8-4dea5be345ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converting VIF {"id": "ec148848-53a7-4ed8-8105-7d95722393bc", "address": "fa:16:3e:f8:8f:4f", "network": {"id": "e03ac49b-a391-40fb-930c-49644a153431", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178490748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2c0cae04ab4b4157a7ef786d165789a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec148848-53", "ovs_interfaceid": "ec148848-53a7-4ed8-8105-7d95722393bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:4f,bridge_name='br-int',has_traffic_filtering=True,id=ec148848-53a7-4ed8-8105-7d95722393bc,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec148848-53') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG os_vif [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:4f,bridge_name='br-int',has_traffic_filtering=True,id=ec148848-53a7-4ed8-8105-7d95722393bc,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec148848-53') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec148848-53, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:24 user nova-compute[71507]: INFO os_vif [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:4f,bridge_name='br-int',has_traffic_filtering=True,id=ec148848-53a7-4ed8-8105-7d95722393bc,network=Network(e03ac49b-a391-40fb-930c-49644a153431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec148848-53')
Apr 13 15:15:24 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Deleting instance files /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae_del
Apr 13 15:15:24 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Deletion of /opt/stack/data/nova/instances/9bad86ad-6d5b-45f1-bcd8-4dea5be345ae_del complete
Apr 13 15:15:24 user nova-compute[71507]: INFO nova.compute.manager [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:15:24 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received event network-vif-deleted-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:15:25 user nova-compute[71507]: INFO nova.compute.manager [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Neutron deleted interface ec148848-53a7-4ed8-8105-7d95722393bc; detaching it from the instance and deleting it from the info cache
Apr 13 15:15:25 user nova-compute[71507]: DEBUG nova.network.neutron [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:15:25 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Took 1.50 seconds to deallocate network for instance.
Apr 13 15:15:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-6059046e-0092-4b64-a61e-e40c192e76a8 req-da15d920-bad0-444c-a0d1-8caf9abcc11b service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Detach interface failed, port_id=ec148848-53a7-4ed8-8105-7d95722393bc, reason: Instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received event network-vif-plugged-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] Acquiring lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] No waiting events found dispatching network-vif-plugged-ec148848-53a7-4ed8-8105-7d95722393bc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:15:25 user nova-compute[71507]: WARNING nova.compute.manager [req-ad612b47-ca5c-4e00-9d55-572d82fcd031 req-d000d07e-2279-4558-b41e-c42fb4c69cb0 service nova] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Received unexpected event network-vif-plugged-ec148848-53a7-4ed8-8105-7d95722393bc for instance with vm_state deleted and task_state None.
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:26 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Deleted allocations for instance 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-26d7e1ab-7088-416a-83c1-92fe5b51e255 tempest-VolumesActionsTest-119634704 tempest-VolumesActionsTest-119634704-project-member] Lock "9bad86ad-6d5b-45f1-bcd8-4dea5be345ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.102s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:27 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:15:27 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8060MB free_disk=26.21807861328125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'flavor' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:27 user nova-compute[71507]: INFO nova.compute.manager [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attaching volume f88a0575-31ac-45a6-a221-4fc8001fd857 to /dev/vdb
Apr 13 15:15:27 user nova-compute[71507]: DEBUG os_brick.utils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[38218dd5-2822-46da-aa7d-ae75a93d41b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2380c74e-4468-45c6-bafc-3e705556e9fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c64408f-c92b-4e9b-a5bf-281bf2c63e2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff9b1e3-e70a-4dae-99ad-d37a03f50e00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:15:27 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a345f780-3523-4604-9bb3-aa04a2950d24]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG os_brick.utils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating existing volume attachment record: de9a7ff5-a121-4c8b-be83-d9d1721f6ed1 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:28 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:28 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:29 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgHULayo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:15:32 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:15:32 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:15:32 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b579052-fd18-4587-8f0b-f831f7bad041]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:15:32 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3651af53-642e-4383-ab19-bfb4de91fb08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857] added
Apr 13 15:15:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bae187-9ad6-444c-af04-3c306dd6bc52]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5504d5d-9af5-4dfb-b42c-9efb7c45bf9d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgHULayo {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgHULayo" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[185db72c-0bf9-4da0-96c2-d44387607719]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zgHULayo'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b4eae0-972e-45ce-9c47-a6f74e245e16]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d33f2-c9e2-4679-b756-5a6b14230107]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:32 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:32 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2ffaf0-4dba-4f25-b09c-f03dcc82c527]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260]
Apr 13 15:15:32 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260] successful.
Apr 13 15:15:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[23af4b35-2ec3-4596-b7e5-c3d66af833e7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3973ca-7858-44ae-8c34-8eb2854adaa6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:32 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:32 user nova-compute[71507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:15:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:32 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:32 user nova-compute[71507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:15:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79e0d26-2330-4b82-9631-18f2dc0d100e]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:15:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgHULayo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:15:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:15:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26464643165623962', 'path': '/dev/sdd'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:15:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464643165623962', 'path': '/dev/sdd'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:15:33 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'flavor' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:15:33 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:15:33 user nova-compute[71507]:   <source dev="/dev/sdd"/>
Apr 13 15:15:33 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:15:33 user nova-compute[71507]:   <serial>f88a0575-31ac-45a6-a221-4fc8001fd857</serial>
Apr 13 15:15:33 user nova-compute[71507]: </disk>
Apr 13 15:15:33 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No VIF found with MAC fa:16:3e:f7:02:ec, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1b9c581-e4e5-4455-a38f-b417cc82753e tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.853s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:35 user nova-compute[71507]: INFO nova.compute.manager [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Rebuilding instance
Apr 13 15:15:35 user nova-compute[71507]: DEBUG nova.objects.instance [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'trusted_certs' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'pci_requests' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'pci_devices' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'resources' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'migration_context' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71507) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:36 user nova-compute[71507]: DEBUG nova.compute.manager [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:15:36 user nova-compute[71507]: WARNING nova.compute.manager [req-a572e42d-75cb-4099-a2e7-91528cb86e1c req-a68c609f-e948-4445-8c66-eb0c21562d3e service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state active and task_state rebuilding.
Apr 13 15:15:36 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance destroyed successfully.
Apr 13 15:15:36 user nova-compute[71507]: INFO nova.compute.manager [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Detaching volume f88a0575-31ac-45a6-a221-4fc8001fd857
Apr 13 15:15:37 user nova-compute[71507]: INFO nova.virt.block_device [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attempting to driver detach volume f88a0575-31ac-45a6-a221-4fc8001fd857 from mountpoint /dev/vdb
Apr 13 15:15:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Attempting to detach device vdb from instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:15:37 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:15:37 user nova-compute[71507]:   <source dev="/dev/sdd"/>
Apr 13 15:15:37 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:15:37 user nova-compute[71507]:   <serial>f88a0575-31ac-45a6-a221-4fc8001fd857</serial>
Apr 13 15:15:37 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:15:37 user nova-compute[71507]: </disk>
Apr 13 15:15:37 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:15:37 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully detached device vdb from instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 from the persistent domain config.
Apr 13 15:15:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgHULayo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:15:37 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e98a37-069b-407e-aa34-044313ca3ac2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:15:37 user nova-compute[71507]: No targets found.
Apr 13 15:15:37 user nova-compute[71507]: iSNS:
Apr 13 15:15:37 user nova-compute[71507]: No targets found.
Apr 13 15:15:37 user nova-compute[71507]: STATIC:
Apr 13 15:15:37 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc
Apr 13 15:15:37 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:15:37 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:15:37 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:15:37 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:15:37 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:15:37 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857
Apr 13 15:15:37 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:15:37 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:15:37 user nova-compute[71507]: FIRMWARE:
Apr 13 15:15:37 user nova-compute[71507]: No targets found.
Apr 13 15:15:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:15:37 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:15:37 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[00658e5c-66dd-4e2b-a303-1a1f2167a9ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14e048e-58d9-4982-8da1-d07f9c6e3bed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:37 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:37 user nova-compute[71507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:15:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:37 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:37 user nova-compute[71507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:15:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c643f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857'): ({'sdd'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Removing single pathed devices sdd {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a63c9b-2519-4af1-b864-353c6809a034]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3266077-04d2-4ab9-ba27-e63d99f2d70c]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flushing IO for device /dev/sdd {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbd70ca-2c57-4d15-a0ff-b533fda6d057]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[132fd40d-0e04-4db1-bc18-523845ffacf7]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed26b292-97d1-41fb-81af-b5505477dafd]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[840f5625-e1c2-4eba-880a-64d7a78d7c4c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260]
Apr 13 15:15:37 user nova-compute[71507]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260] successful.
Apr 13 15:15:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ad964a-c444-4465-8667-939bd5cdf76b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== disconnect_volume: return (317ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:15:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:15:38 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance destroyed successfully.
Apr 13 15:15:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:11:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_vif [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c8ad360-aa, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:38 user nova-compute[71507]: INFO os_vif [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa')
Apr 13 15:15:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgHULayo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:15:38 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5ce19b-9d49-4e0f-88d4-f7b585f06f12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:15:38 user nova-compute[71507]: No targets found.
Apr 13 15:15:38 user nova-compute[71507]: iSNS:
Apr 13 15:15:38 user nova-compute[71507]: No targets found.
Apr 13 15:15:38 user nova-compute[71507]: STATIC:
Apr 13 15:15:38 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc
Apr 13 15:15:38 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:15:38 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:15:38 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:15:38 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:15:38 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:15:38 user nova-compute[71507]: FIRMWARE:
Apr 13 15:15:38 user nova-compute[71507]: No targets found.
Apr 13 15:15:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:15:38 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:15:38 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce3df0-15c1-4630-afc6-2ef23481ef68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ef350-d731-40a7-b110-90dd2d7a58e9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:38 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:38 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1d7a57e0>, {}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Disconnecting from: [] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== disconnect_volume: return (79ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:15:38 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Deleting instance files /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75_del
Apr 13 15:15:38 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Deletion of /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75_del complete
Apr 13 15:15:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:15:38 user nova-compute[71507]: WARNING nova.compute.manager [req-7735f7d0-ea81-42be-ab25-388faf6ead5e req-2c271124-b7a8-430d-99bd-297ed0557c58 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state active and task_state rebuilding.
Apr 13 15:15:38 user nova-compute[71507]: INFO nova.virt.block_device [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Booting with volume f88a0575-31ac-45a6-a221-4fc8001fd857 at /dev/vdb
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.utils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.038s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda7a5d4-50ae-4642-b86e-66420581ca9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedfa7cc-8991-40d9-a7c6-632b56fefa98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd2d8f3-05b4-42db-a5aa-05a87f68ba2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d1df9e-6b7b-4904-a13c-3a721f20dd94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:15:38 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:15:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca2d6e-e4d6-4696-83df-2514c88e23d3]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG os_brick.utils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:15:38 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating existing volume attachment record: fa62db95-5820-41de-ae14-aeca4ec3e76f {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:15:39 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398924.193501, 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:15:39 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] VM Stopped (Lifecycle Event)
Apr 13 15:15:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fef6c02b-7f53-44cb-97db-91af714dd1fc None None] [instance: 9bad86ad-6d5b-45f1-bcd8-4dea5be345ae] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:15:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:15:43 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Creating image(s)
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk 1073741824" returned: 0 in 0.061s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Cannot resize image /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Ensure instance console log exists: /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Start _get_guest_xml network_info=[{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgHULayo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75', 'attached_at': '', 'detached_at': '', 'volume_id': 'f88a0575-31ac-45a6-a221-4fc8001fd857', 'serial': 'f88a0575-31ac-45a6-a221-4fc8001fd857'}, 'attachment_id': 'fa62db95-5820-41de-ae14-aeca4ec3e76f', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:15:43 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 15:15:43 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.objects.instance [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'vcpu_model' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgHULayo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:15:43 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 15:15:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:15:43 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 15:15:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:15:43 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b9ae09-ffa7-4bc8-9a18-e7707927911a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:15:43 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c699b0b7-cdeb-4a13-b2ee-a2e9829b351b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857] added
Apr 13 15:15:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[410937f4-65a1-486c-bc24-b1e2fb230bdc]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ca0d6-bf8e-44c5-b8de-8726d4f72129]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgHULayo {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgHULayo" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef04ada-c5bc-4578-a114-913ef5ef5b8c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zgHULayo'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1b6192-bb5c-4882-beab-8a74c4183df6]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c036cb25-8c1e-4e21-896c-520b490c96ad]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:44 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:44 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:44 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:44 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd4747-1fd8-4d01-a522-e783f7f75b29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260]
Apr 13 15:15:44 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260] successful.
Apr 13 15:15:44 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0252e1d9-dfd8-4be0-817d-96e3e481ddd9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d395df6f-f969-4d5a-be6e-60f39f0fff6f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:44 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:44 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:15:44 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:15:44 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:15:44 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:15:44 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8333c0ad-4542-4c01-aa9f-5924d6a812cf]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:15:44 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgHULayo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26464643165623962', 'path': '/dev/sdd'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464643165623962', 'path': '/dev/sdd'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:11:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:15:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:15:45 user nova-compute[71507]:   <uuid>ccc7b5bd-5f78-448e-bd82-74b2263dff75</uuid>
Apr 13 15:15:45 user nova-compute[71507]:   <name>instance-00000011</name>
Apr 13 15:15:45 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:15:45 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:15:45 user nova-compute[71507]:   <metadata>
Apr 13 15:15:45 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:15:45 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:15:45 user nova-compute[71507]:       <nova:name>tempest-ServerActionsTestJSON-server-2112327637</nova:name>
Apr 13 15:15:45 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:15:43</nova:creationTime>
Apr 13 15:15:45 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:15:45 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:15:45 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:15:45 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:15:45 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:15:45 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:15:45 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:15:45 user nova-compute[71507]:       <nova:owner>
Apr 13 15:15:45 user nova-compute[71507]:         <nova:user uuid="3c12c62d4137473596571e523163e718">tempest-ServerActionsTestJSON-423674903-project-member</nova:user>
Apr 13 15:15:45 user nova-compute[71507]:         <nova:project uuid="9154e4239a1a42a3820c27563ba0513f">tempest-ServerActionsTestJSON-423674903</nova:project>
Apr 13 15:15:45 user nova-compute[71507]:       </nova:owner>
Apr 13 15:15:45 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:15:45 user nova-compute[71507]:       <nova:ports>
Apr 13 15:15:45 user nova-compute[71507]:         <nova:port uuid="9c8ad360-aa62-4ef1-952f-d73f885baa89">
Apr 13 15:15:45 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 15:15:45 user nova-compute[71507]:         </nova:port>
Apr 13 15:15:45 user nova-compute[71507]:       </nova:ports>
Apr 13 15:15:45 user nova-compute[71507]:     </nova:instance>
Apr 13 15:15:45 user nova-compute[71507]:   </metadata>
Apr 13 15:15:45 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:15:45 user nova-compute[71507]:     <system>
Apr 13 15:15:45 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:15:45 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:15:45 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:15:45 user nova-compute[71507]:       <entry name="serial">ccc7b5bd-5f78-448e-bd82-74b2263dff75</entry>
Apr 13 15:15:45 user nova-compute[71507]:       <entry name="uuid">ccc7b5bd-5f78-448e-bd82-74b2263dff75</entry>
Apr 13 15:15:45 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:15:45 user nova-compute[71507]:     </system>
Apr 13 15:15:45 user nova-compute[71507]:   </sysinfo>
Apr 13 15:15:45 user nova-compute[71507]:   <os>
Apr 13 15:15:45 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:15:45 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:15:45 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:15:45 user nova-compute[71507]:   </os>
Apr 13 15:15:45 user nova-compute[71507]:   <features>
Apr 13 15:15:45 user nova-compute[71507]:     <acpi/>
Apr 13 15:15:45 user nova-compute[71507]:     <apic/>
Apr 13 15:15:45 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:15:45 user nova-compute[71507]:   </features>
Apr 13 15:15:45 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:15:45 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:15:45 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:15:45 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:15:45 user nova-compute[71507]:   </clock>
Apr 13 15:15:45 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:15:45 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:15:45 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:15:45 user nova-compute[71507]:   </cpu>
Apr 13 15:15:45 user nova-compute[71507]:   <devices>
Apr 13 15:15:45 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:15:45 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:15:45 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk"/>
Apr 13 15:15:45 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:15:45 user nova-compute[71507]:     </disk>
Apr 13 15:15:45 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:15:45 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:15:45 user nova-compute[71507]:       <source dev="/dev/sdd"/>
Apr 13 15:15:45 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:15:45 user nova-compute[71507]:       <serial>f88a0575-31ac-45a6-a221-4fc8001fd857</serial>
Apr 13 15:15:45 user nova-compute[71507]:     </disk>
Apr 13 15:15:45 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:15:45 user nova-compute[71507]:       <mac address="fa:16:3e:f7:02:ec"/>
Apr 13 15:15:45 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:15:45 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:15:45 user nova-compute[71507]:       <target dev="tap9c8ad360-aa"/>
Apr 13 15:15:45 user nova-compute[71507]:     </interface>
Apr 13 15:15:45 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:15:45 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/console.log" append="off"/>
Apr 13 15:15:45 user nova-compute[71507]:     </serial>
Apr 13 15:15:45 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:15:45 user nova-compute[71507]:     <video>
Apr 13 15:15:45 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:15:45 user nova-compute[71507]:     </video>
Apr 13 15:15:45 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:15:45 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:15:45 user nova-compute[71507]:     </rng>
Apr 13 15:15:45 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:15:45 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:15:45 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:15:45 user nova-compute[71507]:     </memballoon>
Apr 13 15:15:45 user nova-compute[71507]:   </devices>
Apr 13 15:15:45 user nova-compute[71507]: </domain>
Apr 13 15:15:45 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:11:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:15:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG os_vif [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c8ad360-aa, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c8ad360-aa, col_values=(('external_ids', {'iface-id': '9c8ad360-aa62-4ef1-952f-d73f885baa89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:02:ec', 'vm-uuid': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:45 user nova-compute[71507]: INFO os_vif [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa')
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:15:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No VIF found with MAC fa:16:3e:f7:02:ec, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:15:46 user nova-compute[71507]: WARNING nova.compute.manager [req-ae17e5c1-644a-4efb-8294-11738cf3c535 req-3588a003-9622-43a9-bcc3-99be20ce581b service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 15:15:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:15:49 user nova-compute[71507]: WARNING nova.compute.manager [req-7fd6f160-749e-4819-8df4-3bc57d7a5700 req-f17ec27e-e931-4558-b105-759767a586c1 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for ccc7b5bd-5f78-448e-bd82-74b2263dff75 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398949.0983253, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:15:49 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] VM Resumed (Lifecycle Event)
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:15:49 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance spawned successfully.
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:15:49 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398949.0992203, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:15:49 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] VM Started (Lifecycle Event)
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:15:49 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG nova.objects.instance [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71507) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 15:15:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-210d70e3-e6d4-452a-a78b-90bfdc506a9d tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:15:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:15:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:15:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:15:59 user nova-compute[71507]: INFO nova.compute.claims [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Claim successful on node user
Apr 13 15:15:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:15:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:15:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.225s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:16:00 user nova-compute[71507]: INFO nova.compute.claims [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Claim successful on node user
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:16:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.policy [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c83940ddaaf64d94b40df9d00349aa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bad96fcfa0d4691af2a7990ba9dbd09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:16:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Creating image(s)
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk 1073741824" returned: 0 in 0.069s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:16:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:16:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Creating image(s)
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "/opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "/opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.policy [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Cannot resize image /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'migration_context' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Ensure instance console log exists: /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Successfully created port: 6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.167s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk 1073741824" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.150s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:16:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Cannot resize image /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'migration_context' on Instance uuid 3dc146f3-9150-4920-b468-9aebcbc81162 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Ensure instance console log exists: /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Successfully created port: 8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Successfully updated port: 6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquired lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-changed-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Refreshing instance network info cache due to event network-changed-6343df00-b9ef-49a6-be1e-69f12895910f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] Acquiring lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updating instance_info_cache with network_info: [{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Releasing lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Instance network_info: |[{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] Acquired lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Refreshing network info cache for port 6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Start _get_guest_xml network_info=[{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:16:02 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:02 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1194728092',display_name='tempest-ServerRescueNegativeTestJSON-server-1194728092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1194728092',id=21,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK5IRXy1iREs5DJGXQd5/AwCvP1NHbH7B+ioRYx7R5/k6QdMWuWbYssq6+iYLG0++tDjS55HcQeDhgUv/EqHbP9wKGTtL2gyMe13XKrxk7Yzy8UBwjPqj14R6xUkbKGdQ==',key_name='tempest-keypair-1516441123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-cfhhwyv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=8b883f51-b15c-42d7-b71a-e80c11e7d77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:84:55,bridge_name='br-int',has_traffic_filtering=True,id=6343df00-b9ef-49a6-be1e-69f12895910f,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6343df00-b9') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.objects.instance [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:16:02 user nova-compute[71507]:   <uuid>8b883f51-b15c-42d7-b71a-e80c11e7d77e</uuid>
Apr 13 15:16:02 user nova-compute[71507]:   <name>instance-00000015</name>
Apr 13 15:16:02 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:16:02 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:16:02 user nova-compute[71507]:   <metadata>
Apr 13 15:16:02 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:16:02 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:16:02 user nova-compute[71507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1194728092</nova:name>
Apr 13 15:16:02 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:16:02</nova:creationTime>
Apr 13 15:16:02 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:16:02 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:16:02 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:16:02 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:16:02 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:16:02 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:16:02 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:16:02 user nova-compute[71507]:       <nova:owner>
Apr 13 15:16:02 user nova-compute[71507]:         <nova:user uuid="c83940ddaaf64d94b40df9d00349aa91">tempest-ServerRescueNegativeTestJSON-66620130-project-member</nova:user>
Apr 13 15:16:02 user nova-compute[71507]:         <nova:project uuid="9bad96fcfa0d4691af2a7990ba9dbd09">tempest-ServerRescueNegativeTestJSON-66620130</nova:project>
Apr 13 15:16:02 user nova-compute[71507]:       </nova:owner>
Apr 13 15:16:02 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:16:02 user nova-compute[71507]:       <nova:ports>
Apr 13 15:16:02 user nova-compute[71507]:         <nova:port uuid="6343df00-b9ef-49a6-be1e-69f12895910f">
Apr 13 15:16:02 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 15:16:02 user nova-compute[71507]:         </nova:port>
Apr 13 15:16:02 user nova-compute[71507]:       </nova:ports>
Apr 13 15:16:02 user nova-compute[71507]:     </nova:instance>
Apr 13 15:16:02 user nova-compute[71507]:   </metadata>
Apr 13 15:16:02 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:16:02 user nova-compute[71507]:     <system>
Apr 13 15:16:02 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:16:02 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:16:02 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:16:02 user nova-compute[71507]:       <entry name="serial">8b883f51-b15c-42d7-b71a-e80c11e7d77e</entry>
Apr 13 15:16:02 user nova-compute[71507]:       <entry name="uuid">8b883f51-b15c-42d7-b71a-e80c11e7d77e</entry>
Apr 13 15:16:02 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:16:02 user nova-compute[71507]:     </system>
Apr 13 15:16:02 user nova-compute[71507]:   </sysinfo>
Apr 13 15:16:02 user nova-compute[71507]:   <os>
Apr 13 15:16:02 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:16:02 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:16:02 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:16:02 user nova-compute[71507]:   </os>
Apr 13 15:16:02 user nova-compute[71507]:   <features>
Apr 13 15:16:02 user nova-compute[71507]:     <acpi/>
Apr 13 15:16:02 user nova-compute[71507]:     <apic/>
Apr 13 15:16:02 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:16:02 user nova-compute[71507]:   </features>
Apr 13 15:16:02 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:16:02 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:16:02 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:16:02 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:16:02 user nova-compute[71507]:   </clock>
Apr 13 15:16:02 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:16:02 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:16:02 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:16:02 user nova-compute[71507]:   </cpu>
Apr 13 15:16:02 user nova-compute[71507]:   <devices>
Apr 13 15:16:02 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:16:02 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:16:02 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk"/>
Apr 13 15:16:02 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:16:02 user nova-compute[71507]:     </disk>
Apr 13 15:16:02 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:16:02 user nova-compute[71507]:       <mac address="fa:16:3e:96:84:55"/>
Apr 13 15:16:02 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:16:02 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:16:02 user nova-compute[71507]:       <target dev="tap6343df00-b9"/>
Apr 13 15:16:02 user nova-compute[71507]:     </interface>
Apr 13 15:16:02 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:16:02 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/console.log" append="off"/>
Apr 13 15:16:02 user nova-compute[71507]:     </serial>
Apr 13 15:16:02 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:16:02 user nova-compute[71507]:     <video>
Apr 13 15:16:02 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:16:02 user nova-compute[71507]:     </video>
Apr 13 15:16:02 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:16:02 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:16:02 user nova-compute[71507]:     </rng>
Apr 13 15:16:02 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:16:02 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:16:02 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:16:02 user nova-compute[71507]:     </memballoon>
Apr 13 15:16:02 user nova-compute[71507]:   </devices>
Apr 13 15:16:02 user nova-compute[71507]: </domain>
Apr 13 15:16:02 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1194728092',display_name='tempest-ServerRescueNegativeTestJSON-server-1194728092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1194728092',id=21,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK5IRXy1iREs5DJGXQd5/AwCvP1NHbH7B+ioRYx7R5/k6QdMWuWbYssq6+iYLG0++tDjS55HcQeDhgUv/EqHbP9wKGTtL2gyMe13XKrxk7Yzy8UBwjPqj14R6xUkbKGdQ==',key_name='tempest-keypair-1516441123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-cfhhwyv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=8b883f51-b15c-42d7-b71a-e80c11e7d77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:84:55,bridge_name='br-int',has_traffic_filtering=True,id=6343df00-b9ef-49a6-be1e-69f12895910f,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6343df00-b9') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG os_vif [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:84:55,bridge_name='br-int',has_traffic_filtering=True,id=6343df00-b9ef-49a6-be1e-69f12895910f,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6343df00-b9') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6343df00-b9, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6343df00-b9, col_values=(('external_ids', {'iface-id': '6343df00-b9ef-49a6-be1e-69f12895910f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:84:55', 'vm-uuid': '8b883f51-b15c-42d7-b71a-e80c11e7d77e'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:02 user nova-compute[71507]: INFO os_vif [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:84:55,bridge_name='br-int',has_traffic_filtering=True,id=6343df00-b9ef-49a6-be1e-69f12895910f,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6343df00-b9')
Apr 13 15:16:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No VIF found with MAC fa:16:3e:96:84:55, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Successfully updated port: 8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "refresh_cache-3dc146f3-9150-4920-b468-9aebcbc81162" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquired lock "refresh_cache-3dc146f3-9150-4920-b468-9aebcbc81162" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:16:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received event network-changed-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Refreshing instance network info cache due to event network-changed-8f16dd83-a089-414b-9525-cc7ef42c7331. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] Acquiring lock "refresh_cache-3dc146f3-9150-4920-b468-9aebcbc81162" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.neutron [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updated VIF entry in instance network info cache for port 6343df00-b9ef-49a6-be1e-69f12895910f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.neutron [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updating instance_info_cache with network_info: [{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61057416-7471-4f7b-a635-8e88b7b4b9b1 req-88055f87-2ac8-4c53-9ae4-fb03ae553160 service nova] Releasing lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.neutron [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Updating instance_info_cache with network_info: [{"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Releasing lock "refresh_cache-3dc146f3-9150-4920-b468-9aebcbc81162" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Instance network_info: |[{"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] Acquired lock "refresh_cache-3dc146f3-9150-4920-b468-9aebcbc81162" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.neutron [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Refreshing network info cache for port 8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Start _get_guest_xml network_info=[{"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:16:03 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:03 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1109825086',display_name='tempest-AttachVolumeNegativeTest-server-1109825086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1109825086',id=22,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJYk9tq5AvbxsFkvXz5FVdGRka7rNiMF6WvvCvJVSoNv884hYwfP0GXu7pHHmy35RfD0O62LDgQO/pA3hHgZ02L7AhEcCLbnl0u1GsjlLAH6Mo68d+qkyG5GIOBX6RHAA==',key_name='tempest-keypair-1984106079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-3m8j98ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=3dc146f3-9150-4920-b468-9aebcbc81162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:bb:a0,bridge_name='br-int',has_traffic_filtering=True,id=8f16dd83-a089-414b-9525-cc7ef42c7331,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16dd83-a0') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dc146f3-9150-4920-b468-9aebcbc81162 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:16:03 user nova-compute[71507]:   <uuid>3dc146f3-9150-4920-b468-9aebcbc81162</uuid>
Apr 13 15:16:03 user nova-compute[71507]:   <name>instance-00000016</name>
Apr 13 15:16:03 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:16:03 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:16:03 user nova-compute[71507]:   <metadata>
Apr 13 15:16:03 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:16:03 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:16:03 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1109825086</nova:name>
Apr 13 15:16:03 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:16:03</nova:creationTime>
Apr 13 15:16:03 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:16:03 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:16:03 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:16:03 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:16:03 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:16:03 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:16:03 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:16:03 user nova-compute[71507]:       <nova:owner>
Apr 13 15:16:03 user nova-compute[71507]:         <nova:user uuid="fedd34ccc15c47f9a4fc96b080730acd">tempest-AttachVolumeNegativeTest-416139458-project-member</nova:user>
Apr 13 15:16:03 user nova-compute[71507]:         <nova:project uuid="3e3ba2d132c445039d0ae30ffd2bc64a">tempest-AttachVolumeNegativeTest-416139458</nova:project>
Apr 13 15:16:03 user nova-compute[71507]:       </nova:owner>
Apr 13 15:16:03 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:16:03 user nova-compute[71507]:       <nova:ports>
Apr 13 15:16:03 user nova-compute[71507]:         <nova:port uuid="8f16dd83-a089-414b-9525-cc7ef42c7331">
Apr 13 15:16:03 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 15:16:03 user nova-compute[71507]:         </nova:port>
Apr 13 15:16:03 user nova-compute[71507]:       </nova:ports>
Apr 13 15:16:03 user nova-compute[71507]:     </nova:instance>
Apr 13 15:16:03 user nova-compute[71507]:   </metadata>
Apr 13 15:16:03 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:16:03 user nova-compute[71507]:     <system>
Apr 13 15:16:03 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:16:03 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:16:03 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:16:03 user nova-compute[71507]:       <entry name="serial">3dc146f3-9150-4920-b468-9aebcbc81162</entry>
Apr 13 15:16:03 user nova-compute[71507]:       <entry name="uuid">3dc146f3-9150-4920-b468-9aebcbc81162</entry>
Apr 13 15:16:03 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:16:03 user nova-compute[71507]:     </system>
Apr 13 15:16:03 user nova-compute[71507]:   </sysinfo>
Apr 13 15:16:03 user nova-compute[71507]:   <os>
Apr 13 15:16:03 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:16:03 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:16:03 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:16:03 user nova-compute[71507]:   </os>
Apr 13 15:16:03 user nova-compute[71507]:   <features>
Apr 13 15:16:03 user nova-compute[71507]:     <acpi/>
Apr 13 15:16:03 user nova-compute[71507]:     <apic/>
Apr 13 15:16:03 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:16:03 user nova-compute[71507]:   </features>
Apr 13 15:16:03 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:16:03 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:16:03 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:16:03 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:16:03 user nova-compute[71507]:   </clock>
Apr 13 15:16:03 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:16:03 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:16:03 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:16:03 user nova-compute[71507]:   </cpu>
Apr 13 15:16:03 user nova-compute[71507]:   <devices>
Apr 13 15:16:03 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:16:03 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:16:03 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk"/>
Apr 13 15:16:03 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:16:03 user nova-compute[71507]:     </disk>
Apr 13 15:16:03 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:16:03 user nova-compute[71507]:       <mac address="fa:16:3e:fb:bb:a0"/>
Apr 13 15:16:03 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:16:03 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:16:03 user nova-compute[71507]:       <target dev="tap8f16dd83-a0"/>
Apr 13 15:16:03 user nova-compute[71507]:     </interface>
Apr 13 15:16:03 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:16:03 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/console.log" append="off"/>
Apr 13 15:16:03 user nova-compute[71507]:     </serial>
Apr 13 15:16:03 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:16:03 user nova-compute[71507]:     <video>
Apr 13 15:16:03 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:16:03 user nova-compute[71507]:     </video>
Apr 13 15:16:03 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:16:03 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:16:03 user nova-compute[71507]:     </rng>
Apr 13 15:16:03 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:16:03 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:16:03 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:16:03 user nova-compute[71507]:     </memballoon>
Apr 13 15:16:03 user nova-compute[71507]:   </devices>
Apr 13 15:16:03 user nova-compute[71507]: </domain>
Apr 13 15:16:03 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1109825086',display_name='tempest-AttachVolumeNegativeTest-server-1109825086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1109825086',id=22,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJYk9tq5AvbxsFkvXz5FVdGRka7rNiMF6WvvCvJVSoNv884hYwfP0GXu7pHHmy35RfD0O62LDgQO/pA3hHgZ02L7AhEcCLbnl0u1GsjlLAH6Mo68d+qkyG5GIOBX6RHAA==',key_name='tempest-keypair-1984106079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-3m8j98ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=3dc146f3-9150-4920-b468-9aebcbc81162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:bb:a0,bridge_name='br-int',has_traffic_filtering=True,id=8f16dd83-a089-414b-9525-cc7ef42c7331,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16dd83-a0') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG os_vif [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:bb:a0,bridge_name='br-int',has_traffic_filtering=True,id=8f16dd83-a089-414b-9525-cc7ef42c7331,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16dd83-a0') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f16dd83-a0, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f16dd83-a0, col_values=(('external_ids', {'iface-id': '8f16dd83-a089-414b-9525-cc7ef42c7331', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:bb:a0', 'vm-uuid': '3dc146f3-9150-4920-b468-9aebcbc81162'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:03 user nova-compute[71507]: INFO os_vif [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:bb:a0,bridge_name='br-int',has_traffic_filtering=True,id=8f16dd83-a089-414b-9525-cc7ef42c7331,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16dd83-a0')
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No VIF found with MAC fa:16:3e:fb:bb:a0, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.neutron [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Updated VIF entry in instance network info cache for port 8f16dd83-a089-414b-9525-cc7ef42c7331. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG nova.network.neutron [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Updating instance_info_cache with network_info: [{"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:16:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0d76551c-193f-4303-aa16-ea081d2cd823 req-1eadf17a-90f1-425a-93e3-3d761abd93bc service nova] Releasing lock "refresh_cache-3dc146f3-9150-4920-b468-9aebcbc81162" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:16:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:04 user nova-compute[71507]: INFO nova.compute.manager [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Terminating instance
Apr 13 15:16:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:16:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-unplugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] No waiting events found dispatching network-vif-unplugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-4a086318-0f99-430d-8a7f-38955bfa2403 req-b9957546-9071-4e09-bc7a-c399973c5806 service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-unplugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:05 user nova-compute[71507]: WARNING nova.compute.manager [req-5aa99d4c-51b0-415f-81bd-92c06e995f11 req-411b601a-714d-481b-b5f5-f8348256fc71 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state building and task_state spawning.
Apr 13 15:16:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Instance destroyed successfully.
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.objects.instance [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'resources' on Instance uuid 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-377290664',display_name='tempest-TestMinimumBasicScenario-server-377290664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-377290664',id=16,image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2KhvSB5J03IhhEg5JA/tj1cG2BDSPmL+5jFj0Unl3L4uq4s1XIJI5/ab1Vik7nfl+6oJRIw2tTNA1sr/iUc9YAfC+JNpGyE3k2x1hnrhzYW5YHXhMGc7caYhQEORU1KQ==',key_name='tempest-TestMinimumBasicScenario-1980539872',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='738150b0ec0c4ce887397f161c7e8c21',ramdisk_id='',reservation_id='r-ot41eewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='be4d330c-57e5-4ce4-afe8-c2b8be481516',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1239780022',owner_user_name='tempest-TestMinimumBasicScenario-1239780022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:13:26Z,user_data=None,user_id='c2322f71af2a478291bfb9d34046394c',uuid=05d57dd8-f51c-4709-a8b9-2f4aeb3039ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converting VIF {"id": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "address": "fa:16:3e:1f:ca:2e", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf7380-3c", "ovs_interfaceid": "f7bf7380-3c36-4404-8bba-0f64c3fc59a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG os_vif [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7bf7380-3c, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:05 user nova-compute[71507]: INFO os_vif [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ca:2e,bridge_name='br-int',has_traffic_filtering=True,id=f7bf7380-3c36-4404-8bba-0f64c3fc59a3,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf7380-3c')
Apr 13 15:16:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Deleting instance files /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff_del
Apr 13 15:16:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Deletion of /opt/stack/data/nova/instances/05d57dd8-f51c-4709-a8b9-2f4aeb3039ff_del complete
Apr 13 15:16:05 user nova-compute[71507]: INFO nova.compute.manager [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 13 15:16:05 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:16:05 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:16:06 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Took 0.52 seconds to deallocate network for instance.
Apr 13 15:16:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received event network-vif-plugged-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] No waiting events found dispatching network-vif-plugged-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:06 user nova-compute[71507]: WARNING nova.compute.manager [req-6ceecd32-7548-497f-9082-4a38256e74ff req-51da1e8b-e1fd-4585-a52f-055fbea49755 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received unexpected event network-vif-plugged-8f16dd83-a089-414b-9525-cc7ef42c7331 for instance with vm_state building and task_state spawning.
Apr 13 15:16:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:06 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Deleted allocations for instance 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff
Apr 13 15:16:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8a6e1120-24d0-412c-9aec-5aa49d761d87 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.368s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] Acquiring lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] Lock "05d57dd8-f51c-4709-a8b9-2f4aeb3039ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] No waiting events found dispatching network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:07 user nova-compute[71507]: WARNING nova.compute.manager [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received unexpected event network-vif-plugged-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 for instance with vm_state deleted and task_state None.
Apr 13 15:16:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-cec96aab-981d-4486-88df-76f08f5744ca req-95cdc3aa-437b-4d0d-ae02-35bf0f20cc9c service nova] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Received event network-vif-deleted-f7bf7380-3c36-4404-8bba-0f64c3fc59a3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "149f8be9-79d3-4922-b3cc-c164b8b81534" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:07 user nova-compute[71507]: WARNING nova.compute.manager [req-c4e6b7f7-b832-42a6-9d32-9e64f98074f5 req-8ca12565-4840-472f-9899-4bef9797b8f8 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state building and task_state spawning.
Apr 13 15:16:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:16:07 user nova-compute[71507]: INFO nova.compute.claims [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Claim successful on node user
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398968.400567, 8b883f51-b15c-42d7-b71a-e80c11e7d77e => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] VM Resumed (Lifecycle Event)
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Instance spawned successfully.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398968.401085, 8b883f51-b15c-42d7-b71a-e80c11e7d77e => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] VM Started (Lifecycle Event)
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.policy [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Creating image(s)
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "/opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "/opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "/opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398968.5395722, 3dc146f3-9150-4920-b468-9aebcbc81162 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] VM Resumed (Lifecycle Event)
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Took 8.05 seconds to spawn the instance on the hypervisor.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received event network-vif-plugged-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] No waiting events found dispatching network-vif-plugged-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:08 user nova-compute[71507]: WARNING nova.compute.manager [req-a5f1f8d5-e81d-43ea-bee6-f9cedf922937 req-a8e37dbd-2ea1-4319-8dde-13def9329e52 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received unexpected event network-vif-plugged-8f16dd83-a089-414b-9525-cc7ef42c7331 for instance with vm_state building and task_state spawning.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Instance spawned successfully.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398968.541344, 3dc146f3-9150-4920-b468-9aebcbc81162 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] VM Started (Lifecycle Event)
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.162s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Took 8.85 seconds to build instance.
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48c53c5d-18ad-4d2c-86c7-25499c5c8f25 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.990s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Took 7.50 seconds to spawn the instance on the hypervisor.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:08 user nova-compute[71507]: INFO nova.compute.manager [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Took 8.81 seconds to build instance.
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e4d9d3ba-0353-4734-81c8-00c0b9439e5f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.982s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk 1073741824" returned: 0 in 0.055s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Successfully created port: 67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Cannot resize image /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'migration_context' on Instance uuid 149f8be9-79d3-4922-b3cc-c164b8b81534 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Ensure instance console log exists: /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Successfully updated port: 67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "refresh_cache-149f8be9-79d3-4922-b3cc-c164b8b81534" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquired lock "refresh_cache-149f8be9-79d3-4922-b3cc-c164b8b81534" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:16:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received event network-changed-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Refreshing instance network info cache due to event network-changed-67be9d84-c425-4bd9-8b9e-6ea31add6ccf. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] Acquiring lock "refresh_cache-149f8be9-79d3-4922-b3cc-c164b8b81534" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.network.neutron [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Updating instance_info_cache with network_info: [{"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Releasing lock "refresh_cache-149f8be9-79d3-4922-b3cc-c164b8b81534" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Instance network_info: |[{"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] Acquired lock "refresh_cache-149f8be9-79d3-4922-b3cc-c164b8b81534" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.network.neutron [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Refreshing network info cache for port 67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Start _get_guest_xml network_info=[{"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:16:10 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:10 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-604430842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-604430842',id=23,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-ub1aq1gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:16:08Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=149f8be9-79d3-4922-b3cc-c164b8b81534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=67be9d84-c425-4bd9-8b9e-6ea31add6ccf,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67be9d84-c4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'pci_devices' on Instance uuid 149f8be9-79d3-4922-b3cc-c164b8b81534 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:16:10 user nova-compute[71507]:   <uuid>149f8be9-79d3-4922-b3cc-c164b8b81534</uuid>
Apr 13 15:16:10 user nova-compute[71507]:   <name>instance-00000017</name>
Apr 13 15:16:10 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:16:10 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:16:10 user nova-compute[71507]:   <metadata>
Apr 13 15:16:10 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:16:10 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:16:10 user nova-compute[71507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-604430842</nova:name>
Apr 13 15:16:10 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:16:10</nova:creationTime>
Apr 13 15:16:10 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:16:10 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:16:10 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:16:10 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:16:10 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:16:10 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:16:10 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:16:10 user nova-compute[71507]:       <nova:owner>
Apr 13 15:16:10 user nova-compute[71507]:         <nova:user uuid="75bf6e19993f4c2e90fd52c4d6212622">tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member</nova:user>
Apr 13 15:16:10 user nova-compute[71507]:         <nova:project uuid="240b28f42732478ba732994b2c9e3fbe">tempest-ServerBootFromVolumeStableRescueTest-1009244781</nova:project>
Apr 13 15:16:10 user nova-compute[71507]:       </nova:owner>
Apr 13 15:16:10 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:16:10 user nova-compute[71507]:       <nova:ports>
Apr 13 15:16:10 user nova-compute[71507]:         <nova:port uuid="67be9d84-c425-4bd9-8b9e-6ea31add6ccf">
Apr 13 15:16:10 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 15:16:10 user nova-compute[71507]:         </nova:port>
Apr 13 15:16:10 user nova-compute[71507]:       </nova:ports>
Apr 13 15:16:10 user nova-compute[71507]:     </nova:instance>
Apr 13 15:16:10 user nova-compute[71507]:   </metadata>
Apr 13 15:16:10 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:16:10 user nova-compute[71507]:     <system>
Apr 13 15:16:10 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:16:10 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:16:10 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:16:10 user nova-compute[71507]:       <entry name="serial">149f8be9-79d3-4922-b3cc-c164b8b81534</entry>
Apr 13 15:16:10 user nova-compute[71507]:       <entry name="uuid">149f8be9-79d3-4922-b3cc-c164b8b81534</entry>
Apr 13 15:16:10 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:16:10 user nova-compute[71507]:     </system>
Apr 13 15:16:10 user nova-compute[71507]:   </sysinfo>
Apr 13 15:16:10 user nova-compute[71507]:   <os>
Apr 13 15:16:10 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:16:10 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:16:10 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:16:10 user nova-compute[71507]:   </os>
Apr 13 15:16:10 user nova-compute[71507]:   <features>
Apr 13 15:16:10 user nova-compute[71507]:     <acpi/>
Apr 13 15:16:10 user nova-compute[71507]:     <apic/>
Apr 13 15:16:10 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:16:10 user nova-compute[71507]:   </features>
Apr 13 15:16:10 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:16:10 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:16:10 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:16:10 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:16:10 user nova-compute[71507]:   </clock>
Apr 13 15:16:10 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:16:10 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:16:10 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:16:10 user nova-compute[71507]:   </cpu>
Apr 13 15:16:10 user nova-compute[71507]:   <devices>
Apr 13 15:16:10 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:16:10 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:16:10 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk"/>
Apr 13 15:16:10 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:16:10 user nova-compute[71507]:     </disk>
Apr 13 15:16:10 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:16:10 user nova-compute[71507]:       <mac address="fa:16:3e:5d:89:5e"/>
Apr 13 15:16:10 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:16:10 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:16:10 user nova-compute[71507]:       <target dev="tap67be9d84-c4"/>
Apr 13 15:16:10 user nova-compute[71507]:     </interface>
Apr 13 15:16:10 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:16:10 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/console.log" append="off"/>
Apr 13 15:16:10 user nova-compute[71507]:     </serial>
Apr 13 15:16:10 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:16:10 user nova-compute[71507]:     <video>
Apr 13 15:16:10 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:16:10 user nova-compute[71507]:     </video>
Apr 13 15:16:10 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:16:10 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:16:10 user nova-compute[71507]:     </rng>
Apr 13 15:16:10 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:16:10 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:16:10 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:16:10 user nova-compute[71507]:     </memballoon>
Apr 13 15:16:10 user nova-compute[71507]:   </devices>
Apr 13 15:16:10 user nova-compute[71507]: </domain>
Apr 13 15:16:10 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-604430842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-604430842',id=23,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-ub1aq1gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:16:08Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=149f8be9-79d3-4922-b3cc-c164b8b81534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=67be9d84-c425-4bd9-8b9e-6ea31add6ccf,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67be9d84-c4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG os_vif [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=67be9d84-c425-4bd9-8b9e-6ea31add6ccf,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67be9d84-c4') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67be9d84-c4, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67be9d84-c4, col_values=(('external_ids', {'iface-id': '67be9d84-c425-4bd9-8b9e-6ea31add6ccf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:89:5e', 'vm-uuid': '149f8be9-79d3-4922-b3cc-c164b8b81534'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:10 user nova-compute[71507]: INFO os_vif [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=67be9d84-c425-4bd9-8b9e-6ea31add6ccf,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67be9d84-c4')
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:16:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No VIF found with MAC fa:16:3e:5d:89:5e, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:16:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Updated VIF entry in instance network info cache for port 67be9d84-c425-4bd9-8b9e-6ea31add6ccf. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:16:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Updating instance_info_cache with network_info: [{"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:16:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-35be5dbb-6bd8-4d34-b472-1ac16e111eb5 req-5fbe8e03-fbeb-4231-81ed-b1bb446151d3 service nova] Releasing lock "refresh_cache-149f8be9-79d3-4922-b3cc-c164b8b81534" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received event network-vif-plugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] Acquiring lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] No waiting events found dispatching network-vif-plugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:12 user nova-compute[71507]: WARNING nova.compute.manager [req-f4ef729f-e3ee-4079-a883-1100dc8d6b0f req-440fa917-7475-4f6e-8580-d11cdf2449d1 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received unexpected event network-vif-plugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance with vm_state building and task_state spawning.
Apr 13 15:16:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398974.6202266, 149f8be9-79d3-4922-b3cc-c164b8b81534 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:16:14 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] VM Resumed (Lifecycle Event)
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:16:14 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Instance spawned successfully.
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received event network-vif-plugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] Acquiring lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] No waiting events found dispatching network-vif-plugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:14 user nova-compute[71507]: WARNING nova.compute.manager [req-e90034d5-8020-4c8d-9bef-cd0a4ffc0fad req-179acdb7-05cb-41a0-b2ee-eb98a873f84e service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received unexpected event network-vif-plugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance with vm_state building and task_state spawning.
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:16:14 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681398974.6232076, 149f8be9-79d3-4922-b3cc-c164b8b81534 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:16:14 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] VM Started (Lifecycle Event)
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:16:14 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:16:14 user nova-compute[71507]: INFO nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Took 6.32 seconds to spawn the instance on the hypervisor.
Apr 13 15:16:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:14 user nova-compute[71507]: INFO nova.compute.manager [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Took 7.13 seconds to build instance.
Apr 13 15:16:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fcc95a2a-c351-4651-be6e-7b26382eae4e tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.226s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:18 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:16:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:16:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:16:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:16:18 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:16:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updating instance_info_cache with network_info: [{"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:16:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:16:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:16:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:20 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681398965.851458, 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:16:20 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] VM Stopped (Lifecycle Event)
Apr 13 15:16:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9ba0b399-6a62-441b-83f6-bce1b4e4c36f None None] [instance: 05d57dd8-f51c-4709-a8b9-2f4aeb3039ff] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:16:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:16:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:16:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:16:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:29 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:29 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7845MB free_disk=26.043724060058594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 3dc146f3-9150-4920-b468-9aebcbc81162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:16:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:16:30 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:16:30 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:16:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:16:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.133s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:31 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:16:31 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:16:31 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:16:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:16:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquired lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:16:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:16:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'info_cache' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updating instance_info_cache with network_info: [{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Releasing lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:16:37 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance destroyed successfully.
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'resources' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1504684221',display_name='tempest-AttachVolumeTestJSON-server-1504684221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1504684221',id=18,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w==',key_name='tempest-keypair-668401822',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-0f5qbue4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=1aa74d14-db6f-41f5-b8af-32da312209d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_vif [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84611f06-d6, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:16:37 user nova-compute[71507]: INFO os_vif [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6')
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIFDdulb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:16:37 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.060s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fc43c7-9936-40be-99cb-5ac87c9d2f9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:16:37 user nova-compute[71507]: No targets found.
Apr 13 15:16:37 user nova-compute[71507]: iSNS:
Apr 13 15:16:37 user nova-compute[71507]: No targets found.
Apr 13 15:16:37 user nova-compute[71507]: STATIC:
Apr 13 15:16:37 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc
Apr 13 15:16:37 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:16:37 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:16:37 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96
Apr 13 15:16:37 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:16:37 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:16:37 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:16:37 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:16:37 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:16:37 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857
Apr 13 15:16:37 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:16:37 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:16:37 user nova-compute[71507]: FIRMWARE:
Apr 13 15:16:37 user nova-compute[71507]: No targets found.
Apr 13 15:16:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:16:37 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:16:37 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e946965c-cefd-4a07-9dec-e8881cf45b9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[060bd56a-1a7d-4d11-bd6b-529ee3842105]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:16:37 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:16:37 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:16:37 user nova-compute[71507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96 (non-flash)
Apr 13 15:16:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:16:37 user nova-compute[71507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:16:37 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:16:37 user nova-compute[71507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96 (non-flash)
Apr 13 15:16:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1422ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[50431f98-1589-4b35-9df8-d4b073bf6b8e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5c9c9f-0cc1-4ebb-b13b-6049942ee309]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e2985-583f-409c-9902-f20498e471d4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.164s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb3e541-dd47-46b9-b690-f39e09ea6443]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_46b099f8', '/dev/disk/by-id/scsi-1SCST_BIO46b099f8-030fbcbd86f30dbd', '/dev/disk/by-id/scsi-23033306662636264') {{(pid=81901) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4328dcbb-6ec7-4184-b14b-1c61864dc417]: (4, None) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf2b543-182b-4306-bd46-775ee5b79f9f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c02799d-70e2-4fcc-b8ec-5005a5cc08e0]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260]
Apr 13 15:16:37 user nova-compute[71507]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260] successful.
Apr 13 15:16:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2ff0c-e1cd-439b-94cc-6fa07ae8663b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.518s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== disconnect_volume: return (520ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Start _get_guest_xml network_info=[{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIFDdulb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1aa74d14-db6f-41f5-b8af-32da312209d3', 'attached_at': '', 'detached_at': '', 'volume_id': '833def22-5680-4c24-9368-2130eefccdfc', 'serial': '833def22-5680-4c24-9368-2130eefccdfc'}, 'attachment_id': '66c2640f-a776-48c5-ac32-3c4022e16914', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'numa_topology' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:37 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:37 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIFDdulb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:16:37 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:16:37 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:16:37 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[04084aec-4e38-4ffc-9796-77d21128e8a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:16:37 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc21b04-3964-436f-93bf-2ddf2723eb18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc] added
Apr 13 15:16:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.101s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb28bd15-6150-461a-be5a-020cf27cbd37]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.065s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd3504c-a01b-48b9-b536-bbf053dcb1e1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIFDdulb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIFDdulb" returned: 0 in 0.096s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0937648-6ece-48eb-a521-2da8e13b945f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIFDdulb'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.069s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cf0001-d936-43e3-9225-b2317691bd49]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e25c14-bdda-4b62-9b21-3ada7833ca52]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --login" returned: 0 in 0.178s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f27bba2-afe7-47bc-ab75-ff6103c398f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260]
Apr 13 15:16:38 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260] successful.
Apr 13 15:16:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf37f5a-c490-4614-ab36-eb4e1c31eb77]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fafd4c9-78e0-40f4-a296-6c13beb0bfc8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:16:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ed00d8-0467-4a99-a300-d1796cb73c96 (non-flash)
Apr 13 15:16:38 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:16:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.742s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.055s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b2468e-9f1c-4d4f-b4fb-74b528bc704c]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:16:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIFDdulb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:16:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.812s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:16:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== connect_volume: return (1813ms) {'type': 'block', 'scsi_wwn': '23033306662636264', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:16:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033306662636264', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:16:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1504684221',display_name='tempest-AttachVolumeTestJSON-server-1504684221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1504684221',id=18,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w==',key_name='tempest-keypair-668401822',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-0f5qbue4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=1aa74d14-db6f-41f5-b8af-32da312209d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:16:39 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:39 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:39 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:16:39 user nova-compute[71507]:   <uuid>1aa74d14-db6f-41f5-b8af-32da312209d3</uuid>
Apr 13 15:16:39 user nova-compute[71507]:   <name>instance-00000012</name>
Apr 13 15:16:39 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:16:39 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:16:39 user nova-compute[71507]:   <metadata>
Apr 13 15:16:39 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:16:39 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:16:39 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeTestJSON-server-1504684221</nova:name>
Apr 13 15:16:39 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:16:37</nova:creationTime>
Apr 13 15:16:39 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:16:39 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:16:39 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:16:39 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:16:39 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:16:39 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:16:39 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:16:39 user nova-compute[71507]:       <nova:owner>
Apr 13 15:16:39 user nova-compute[71507]:         <nova:user uuid="de1a698b103a47c0b2864eef54be648b">tempest-AttachVolumeTestJSON-157319562-project-member</nova:user>
Apr 13 15:16:39 user nova-compute[71507]:         <nova:project uuid="ceba33821a9b4f7aa81c2857c11261f1">tempest-AttachVolumeTestJSON-157319562</nova:project>
Apr 13 15:16:39 user nova-compute[71507]:       </nova:owner>
Apr 13 15:16:39 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:16:39 user nova-compute[71507]:       <nova:ports>
Apr 13 15:16:39 user nova-compute[71507]:         <nova:port uuid="84611f06-d6ca-49e1-afe7-7723921e62dc">
Apr 13 15:16:39 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 15:16:39 user nova-compute[71507]:         </nova:port>
Apr 13 15:16:39 user nova-compute[71507]:       </nova:ports>
Apr 13 15:16:39 user nova-compute[71507]:     </nova:instance>
Apr 13 15:16:39 user nova-compute[71507]:   </metadata>
Apr 13 15:16:39 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:16:39 user nova-compute[71507]:     <system>
Apr 13 15:16:39 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:16:39 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:16:39 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:16:39 user nova-compute[71507]:       <entry name="serial">1aa74d14-db6f-41f5-b8af-32da312209d3</entry>
Apr 13 15:16:39 user nova-compute[71507]:       <entry name="uuid">1aa74d14-db6f-41f5-b8af-32da312209d3</entry>
Apr 13 15:16:39 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:16:39 user nova-compute[71507]:     </system>
Apr 13 15:16:39 user nova-compute[71507]:   </sysinfo>
Apr 13 15:16:39 user nova-compute[71507]:   <os>
Apr 13 15:16:39 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:16:39 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:16:39 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:16:39 user nova-compute[71507]:   </os>
Apr 13 15:16:39 user nova-compute[71507]:   <features>
Apr 13 15:16:39 user nova-compute[71507]:     <acpi/>
Apr 13 15:16:39 user nova-compute[71507]:     <apic/>
Apr 13 15:16:39 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:16:39 user nova-compute[71507]:   </features>
Apr 13 15:16:39 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:16:39 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:16:39 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:16:39 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:16:39 user nova-compute[71507]:   </clock>
Apr 13 15:16:39 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:16:39 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:16:39 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:16:39 user nova-compute[71507]:   </cpu>
Apr 13 15:16:39 user nova-compute[71507]:   <devices>
Apr 13 15:16:39 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:16:39 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:16:39 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk"/>
Apr 13 15:16:39 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:16:39 user nova-compute[71507]:     </disk>
Apr 13 15:16:39 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:16:39 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:16:39 user nova-compute[71507]:       <source dev="/dev/sdc"/>
Apr 13 15:16:39 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:16:39 user nova-compute[71507]:       <serial>833def22-5680-4c24-9368-2130eefccdfc</serial>
Apr 13 15:16:39 user nova-compute[71507]:     </disk>
Apr 13 15:16:39 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:16:39 user nova-compute[71507]:       <mac address="fa:16:3e:a3:4a:01"/>
Apr 13 15:16:39 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:16:39 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:16:39 user nova-compute[71507]:       <target dev="tap84611f06-d6"/>
Apr 13 15:16:39 user nova-compute[71507]:     </interface>
Apr 13 15:16:39 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:16:39 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/console.log" append="off"/>
Apr 13 15:16:39 user nova-compute[71507]:     </serial>
Apr 13 15:16:39 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:16:39 user nova-compute[71507]:     <video>
Apr 13 15:16:39 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:16:39 user nova-compute[71507]:     </video>
Apr 13 15:16:39 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:16:39 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:16:39 user nova-compute[71507]:     </rng>
Apr 13 15:16:39 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:16:39 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:16:39 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:16:39 user nova-compute[71507]:     </memballoon>
Apr 13 15:16:39 user nova-compute[71507]:   </devices>
Apr 13 15:16:39 user nova-compute[71507]: </domain>
Apr 13 15:16:39 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:16:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.633s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:16:40 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:40 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:16:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Cannot resize image /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'migration_context' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1504684221',display_name='tempest-AttachVolumeTestJSON-server-1504684221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1504684221',id=18,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w==',key_name='tempest-keypair-668401822',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-0f5qbue4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=1aa74d14-db6f-41f5-b8af-32da312209d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG os_vif [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84611f06-d6, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84611f06-d6, col_values=(('external_ids', {'iface-id': '84611f06-d6ca-49e1-afe7-7723921e62dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:4a:01', 'vm-uuid': '1aa74d14-db6f-41f5-b8af-32da312209d3'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:16:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:41 user nova-compute[71507]: INFO os_vif [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6')
Apr 13 15:16:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:42 user nova-compute[71507]: WARNING nova.compute.manager [req-7b9f0494-8916-4d11-8c39-adf6d14cb341 req-ec086125-4f9b-45c7-afaf-0ebbda227196 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state stopped and task_state powering-on.
Apr 13 15:16:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:16:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:16:45 user nova-compute[71507]: WARNING nova.compute.manager [req-763b6e50-116c-4440-b776-f80b72b6f865 req-3bebddbd-78fd-415b-a6b7-6fd4107c5620 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state stopped and task_state powering-on.
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399005.0256152, 1aa74d14-db6f-41f5-b8af-32da312209d3 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:16:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] VM Resumed (Lifecycle Event)
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:16:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance rebooted successfully.
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f51b85c1-d467-4e49-a626-342ab2a6e222 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:16:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399005.0265508, 1aa74d14-db6f-41f5-b8af-32da312209d3 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:16:45 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] VM Started (Lifecycle Event)
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:16:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:16:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:16:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:16:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:58 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:16:58 user nova-compute[71507]: INFO nova.compute.claims [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Claim successful on node user
Apr 13 15:16:59 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:16:59 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:16:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG nova.policy [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2322f71af2a478291bfb9d34046394c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738150b0ec0c4ce887397f161c7e8c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:16:59 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Creating image(s)
Apr 13 15:16:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "/opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "/opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "1f59a8aac6c4890ef0aae4cf870b2343c176bee1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "1f59a8aac6c4890ef0aae4cf870b2343c176bee1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:16:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1.part --force-share --output=json" returned: 0 in 0.161s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG nova.virt.images [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] a611381e-716d-4625-bba9-2ca0eb316ad3 was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1.part /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Successfully created port: df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1.part /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1.converted" returned: 0 in 0.269s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "1f59a8aac6c4890ef0aae4cf870b2343c176bee1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.092s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1 --force-share --output=json" returned: 0 in 0.161s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "1f59a8aac6c4890ef0aae4cf870b2343c176bee1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "1f59a8aac6c4890ef0aae4cf870b2343c176bee1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1 --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1,backing_fmt=raw /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1,backing_fmt=raw /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk 1073741824" returned: 0 in 0.051s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "1f59a8aac6c4890ef0aae4cf870b2343c176bee1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Successfully updated port: df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquired lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing instance network info cache due to event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] Acquiring lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Cannot resize image /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'migration_context' on Instance uuid e1c4cb29-65fa-4b48-b7a2-cac613cb96fe {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Ensure instance console log exists: /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updating instance_info_cache with network_info: [{"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Releasing lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Instance network_info: |[{"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] Acquired lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.network.neutron [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Start _get_guest_xml network_info=[{"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:16:56Z,direct_url=<?>,disk_format='qcow2',id=a611381e-716d-4625-bba9-2ca0eb316ad3,min_disk=0,min_ram=0,name='tempest-scenario-img--1232735746',owner='738150b0ec0c4ce887397f161c7e8c21',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:16:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': 'a611381e-716d-4625-bba9-2ca0eb316ad3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:17:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:17:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:16:56Z,direct_url=<?>,disk_format='qcow2',id=a611381e-716d-4625-bba9-2ca0eb316ad3,min_disk=0,min_ram=0,name='tempest-scenario-img--1232735746',owner='738150b0ec0c4ce887397f161c7e8c21',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:16:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-460869719',display_name='tempest-TestMinimumBasicScenario-server-460869719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-460869719',id=24,image_ref='a611381e-716d-4625-bba9-2ca0eb316ad3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDICxl86jLmymXogxNUJnQZrjPr/+8MrnAGTcu90n9UjsNhs+u6Mh3/NJl7vyFtf7K8I7ur6kH+VunKTEjTglWZT45qzOhWEU+r6IQk98Mkud+AgqZr5Ga1+FcK2IHkJEA==',key_name='tempest-TestMinimumBasicScenario-1152073766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='738150b0ec0c4ce887397f161c7e8c21',ramdisk_id='',reservation_id='r-3n09o9t8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a611381e-716d-4625-bba9-2ca0eb316ad3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1239780022',owner_user_name='tempest-TestMinimumBasicScenario-1239780022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:16:59Z,user_data=None,user_id='c2322f71af2a478291bfb9d34046394c',uuid=e1c4cb29-65fa-4b48-b7a2-cac613cb96fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converting VIF {"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=df99421e-bdc6-4fe5-9865-823bcb128ccc,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf99421e-bd') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'pci_devices' on Instance uuid e1c4cb29-65fa-4b48-b7a2-cac613cb96fe {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:17:01 user nova-compute[71507]:   <uuid>e1c4cb29-65fa-4b48-b7a2-cac613cb96fe</uuid>
Apr 13 15:17:01 user nova-compute[71507]:   <name>instance-00000018</name>
Apr 13 15:17:01 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:17:01 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:17:01 user nova-compute[71507]:   <metadata>
Apr 13 15:17:01 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:17:01 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:17:01 user nova-compute[71507]:       <nova:name>tempest-TestMinimumBasicScenario-server-460869719</nova:name>
Apr 13 15:17:01 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:17:01</nova:creationTime>
Apr 13 15:17:01 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:17:01 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:17:01 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:17:01 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:17:01 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:17:01 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:17:01 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:17:01 user nova-compute[71507]:       <nova:owner>
Apr 13 15:17:01 user nova-compute[71507]:         <nova:user uuid="c2322f71af2a478291bfb9d34046394c">tempest-TestMinimumBasicScenario-1239780022-project-member</nova:user>
Apr 13 15:17:01 user nova-compute[71507]:         <nova:project uuid="738150b0ec0c4ce887397f161c7e8c21">tempest-TestMinimumBasicScenario-1239780022</nova:project>
Apr 13 15:17:01 user nova-compute[71507]:       </nova:owner>
Apr 13 15:17:01 user nova-compute[71507]:       <nova:root type="image" uuid="a611381e-716d-4625-bba9-2ca0eb316ad3"/>
Apr 13 15:17:01 user nova-compute[71507]:       <nova:ports>
Apr 13 15:17:01 user nova-compute[71507]:         <nova:port uuid="df99421e-bdc6-4fe5-9865-823bcb128ccc">
Apr 13 15:17:01 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 15:17:01 user nova-compute[71507]:         </nova:port>
Apr 13 15:17:01 user nova-compute[71507]:       </nova:ports>
Apr 13 15:17:01 user nova-compute[71507]:     </nova:instance>
Apr 13 15:17:01 user nova-compute[71507]:   </metadata>
Apr 13 15:17:01 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:17:01 user nova-compute[71507]:     <system>
Apr 13 15:17:01 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:17:01 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:17:01 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:17:01 user nova-compute[71507]:       <entry name="serial">e1c4cb29-65fa-4b48-b7a2-cac613cb96fe</entry>
Apr 13 15:17:01 user nova-compute[71507]:       <entry name="uuid">e1c4cb29-65fa-4b48-b7a2-cac613cb96fe</entry>
Apr 13 15:17:01 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:17:01 user nova-compute[71507]:     </system>
Apr 13 15:17:01 user nova-compute[71507]:   </sysinfo>
Apr 13 15:17:01 user nova-compute[71507]:   <os>
Apr 13 15:17:01 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:17:01 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:17:01 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:17:01 user nova-compute[71507]:   </os>
Apr 13 15:17:01 user nova-compute[71507]:   <features>
Apr 13 15:17:01 user nova-compute[71507]:     <acpi/>
Apr 13 15:17:01 user nova-compute[71507]:     <apic/>
Apr 13 15:17:01 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:17:01 user nova-compute[71507]:   </features>
Apr 13 15:17:01 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:17:01 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:17:01 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:17:01 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:17:01 user nova-compute[71507]:   </clock>
Apr 13 15:17:01 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:17:01 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:17:01 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:17:01 user nova-compute[71507]:   </cpu>
Apr 13 15:17:01 user nova-compute[71507]:   <devices>
Apr 13 15:17:01 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:17:01 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:17:01 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk"/>
Apr 13 15:17:01 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:17:01 user nova-compute[71507]:     </disk>
Apr 13 15:17:01 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:17:01 user nova-compute[71507]:       <mac address="fa:16:3e:a5:0d:f6"/>
Apr 13 15:17:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:17:01 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:17:01 user nova-compute[71507]:       <target dev="tapdf99421e-bd"/>
Apr 13 15:17:01 user nova-compute[71507]:     </interface>
Apr 13 15:17:01 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:17:01 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/console.log" append="off"/>
Apr 13 15:17:01 user nova-compute[71507]:     </serial>
Apr 13 15:17:01 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:17:01 user nova-compute[71507]:     <video>
Apr 13 15:17:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:17:01 user nova-compute[71507]:     </video>
Apr 13 15:17:01 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:17:01 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:17:01 user nova-compute[71507]:     </rng>
Apr 13 15:17:01 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:17:01 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:17:01 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:17:01 user nova-compute[71507]:     </memballoon>
Apr 13 15:17:01 user nova-compute[71507]:   </devices>
Apr 13 15:17:01 user nova-compute[71507]: </domain>
Apr 13 15:17:01 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-460869719',display_name='tempest-TestMinimumBasicScenario-server-460869719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-460869719',id=24,image_ref='a611381e-716d-4625-bba9-2ca0eb316ad3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDICxl86jLmymXogxNUJnQZrjPr/+8MrnAGTcu90n9UjsNhs+u6Mh3/NJl7vyFtf7K8I7ur6kH+VunKTEjTglWZT45qzOhWEU+r6IQk98Mkud+AgqZr5Ga1+FcK2IHkJEA==',key_name='tempest-TestMinimumBasicScenario-1152073766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='738150b0ec0c4ce887397f161c7e8c21',ramdisk_id='',reservation_id='r-3n09o9t8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a611381e-716d-4625-bba9-2ca0eb316ad3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1239780022',owner_user_name='tempest-TestMinimumBasicScenario-1239780022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:16:59Z,user_data=None,user_id='c2322f71af2a478291bfb9d34046394c',uuid=e1c4cb29-65fa-4b48-b7a2-cac613cb96fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converting VIF {"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=df99421e-bdc6-4fe5-9865-823bcb128ccc,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf99421e-bd') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG os_vif [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=df99421e-bdc6-4fe5-9865-823bcb128ccc,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf99421e-bd') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf99421e-bd, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf99421e-bd, col_values=(('external_ids', {'iface-id': 'df99421e-bdc6-4fe5-9865-823bcb128ccc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:0d:f6', 'vm-uuid': 'e1c4cb29-65fa-4b48-b7a2-cac613cb96fe'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:01 user nova-compute[71507]: INFO os_vif [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=df99421e-bdc6-4fe5-9865-823bcb128ccc,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf99421e-bd')
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:17:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No VIF found with MAC fa:16:3e:a5:0d:f6, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:17:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updated VIF entry in instance network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:17:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updating instance_info_cache with network_info: [{"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:17:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a6c90515-488d-44e0-9178-c067086f84f7 req-8ffbf908-619a-460e-acd9-9dd5e5daca51 service nova] Releasing lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:17:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] No waiting events found dispatching network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:17:03 user nova-compute[71507]: WARNING nova.compute.manager [req-0004fcd8-364b-4a33-a7f3-52b66138da8e req-d75d8e02-448d-44e8-860f-8b201ddee208 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received unexpected event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc for instance with vm_state building and task_state spawning.
Apr 13 15:17:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] No waiting events found dispatching network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:17:05 user nova-compute[71507]: WARNING nova.compute.manager [req-cc1ca94a-c2fe-4475-a773-c6080b6d0150 req-ae3c8475-25fc-4f13-8416-bd01aa924d0b service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received unexpected event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc for instance with vm_state building and task_state spawning.
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399025.4481945, e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:17:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] VM Resumed (Lifecycle Event)
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:17:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Instance spawned successfully.
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:17:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399025.4507163, e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:17:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] VM Started (Lifecycle Event)
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:17:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:17:05 user nova-compute[71507]: INFO nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Took 6.12 seconds to spawn the instance on the hypervisor.
Apr 13 15:17:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:17:05 user nova-compute[71507]: INFO nova.compute.manager [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Took 6.98 seconds to build instance.
Apr 13 15:17:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8aa4199b-cbf2-4e20-b3b6-888c9f11ee39 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.118s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:18 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:17:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:17:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:17:18 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:17:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updating instance_info_cache with network_info: [{"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:17:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:17:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:17:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:25 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:25 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:17:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:30 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:17:30 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7663MB free_disk=26.102375030517578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 3dc146f3-9150-4920-b468-9aebcbc81162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:17:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:17:31 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:17:31 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:17:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:17:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:17:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:17:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:17:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:17:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:17:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received event network-changed-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Refreshing instance network info cache due to event network-changed-8f16dd83-a089-414b-9525-cc7ef42c7331. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] Acquiring lock "refresh_cache-3dc146f3-9150-4920-b468-9aebcbc81162" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] Acquired lock "refresh_cache-3dc146f3-9150-4920-b468-9aebcbc81162" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG nova.network.neutron [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Refreshing network info cache for port 8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-changed-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Refreshing instance network info cache due to event network-changed-6343df00-b9ef-49a6-be1e-69f12895910f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] Acquiring lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] Acquired lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG nova.network.neutron [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Refreshing network info cache for port 6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:50 user nova-compute[71507]: DEBUG nova.objects.instance [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'flavor' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:51 user nova-compute[71507]: INFO nova.compute.manager [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Attaching volume e0953e89-df86-47d7-9d9d-a5e263476027 to /dev/vdb
Apr 13 15:17:51 user nova-compute[71507]: DEBUG os_brick.utils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c17363b-a45f-4b5d-b4c1-5f0a3115bfa2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd8cf3d-e127-494c-9563-a08dae0eab8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4ea956-5e78-4191-a80a-8c413a174025]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e419f185-82be-42f0-960e-ff716ebdc360]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:17:51 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c50d88d-b893-4263-b6de-c9c93ea52adc]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG os_brick.utils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updating existing volume attachment record: 74e043ec-7de4-4eb3-801a-1797b0429899 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG nova.network.neutron [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Updated VIF entry in instance network info cache for port 8f16dd83-a089-414b-9525-cc7ef42c7331. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG nova.network.neutron [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Updating instance_info_cache with network_info: [{"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bf841943-f73d-428a-8282-bcc27da99eaa req-9f7b68c0-435b-4dd9-a38c-0651c6b8cb54 service nova] Releasing lock "refresh_cache-3dc146f3-9150-4920-b468-9aebcbc81162" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG nova.network.neutron [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updated VIF entry in instance network info cache for port 6343df00-b9ef-49a6-be1e-69f12895910f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG nova.network.neutron [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updating instance_info_cache with network_info: [{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f8636ac3-f2d1-47ce-a5ca-f85289a3fdd2 req-af16465a-3a08-4f4c-8678-6f73aaca3b37 service nova] Releasing lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:17:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'flavor' on Instance uuid 3dc146f3-9150-4920-b468-9aebcbc81162 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:17:53 user nova-compute[71507]: INFO nova.compute.manager [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Attaching volume 73467274-8e1f-4536-9458-f3e619202566 to /dev/vdb
Apr 13 15:17:53 user nova-compute[71507]: DEBUG os_brick.utils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b048869a-b931-4265-a889-7c5db2311314]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c715929e-ac51-42c1-8b40-6773e342feda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[301e826d-06ba-47b4-9182-5fd6121e31e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[441fd107-8848-4fc8-93c5-dfbeae6d70b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:17:53 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:17:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cede043-2404-413a-851f-01c231576f8b]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG os_brick.utils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:17:53 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Updating existing volume attachment record: 6746b336-5143-4f0c-93d7-25883f2715af {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvzgfSDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:17:56 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:17:56 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:17:56 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9527f60-e523-4814-b6d9-489918d2f08a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:17:56 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[876016e0-26c3-4b81-99e5-9ffb18b5940e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027] added
Apr 13 15:17:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef281d5-43ae-4239-984d-fa6b1876bac7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[084702ff-d6c1-4ba3-a1f8-97a5ad2bd3b6]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvzgfSDr {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvzgfSDr" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4953e3-0359-45b6-beb1-3357fdb874f2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VvzgfSDr'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71fd158-d24d-4066-964e-995f072b679f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbe3d60-0738-49ba-8267-89d910e9dd1b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:17:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:17:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7345b8e9-25f2-4cc1-87b1-a4d6718e1086]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027, portal: 172.16.0.220,3260]
Apr 13 15:17:56 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027, portal: 172.16.0.220,3260] successful.
Apr 13 15:17:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da91913-4829-43f1-8e9f-5eae3f0984ca]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[794b3e17-372b-4eb4-b267-9daf48368f3e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:17:56 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:17:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef3ac4e-6c02-4a1b-893e-14a7c157c0fb]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvzgfSDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:17:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26137616165643439', 'path': '/dev/sde'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137616165643439', 'path': '/dev/sde'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG nova.objects.instance [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'flavor' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:17:57 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:17:57 user nova-compute[71507]:   <source dev="/dev/sde"/>
Apr 13 15:17:57 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:17:57 user nova-compute[71507]:   <serial>e0953e89-df86-47d7-9d9d-a5e263476027</serial>
Apr 13 15:17:57 user nova-compute[71507]: </disk>
Apr 13 15:17:57 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No VIF found with MAC fa:16:3e:96:84:55, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:17:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-912c810b-408c-4785-a6f3-179d253a7e30 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.738s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:17:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:17:58 user nova-compute[71507]: INFO nova.compute.manager [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] instance snapshotting
Apr 13 15:17:58 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Beginning live snapshot process
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json -f qcow2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json -f qcow2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: INFO nova.compute.manager [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Rescuing
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquired lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.150s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphtva464b/1c24e265fe29488a85ba7c75ced3528a.delta 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphtva464b/1c24e265fe29488a85ba7c75ced3528a.delta 1073741824" returned: 0 in 0.051s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 15:17:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIEQTyxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:17:59 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:17:59 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:17:59 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5156ca8-c250-433b-8834-988a4c21cc96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:17:59 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28a76b6-6be5-43ad-ba24-3f65ff57b7ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566] added
Apr 13 15:17:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updating instance_info_cache with network_info: [{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2509b1f8-f0ce-40f3-be5e-47859f1f9d98]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Releasing lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[696ad3e2-c4b1-4920-ab59-c70524f5fec3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lIEQTyxS {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lIEQTyxS" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd7386-cd20-4487-a696-f73ec2f301e8]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lIEQTyxS'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e680ee-4add-41f5-80ad-efc007186f35]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d362db-095e-4186-9ed0-0ab1c804d281]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:17:59 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:17:59 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:17:59 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:17:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:17:59 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:17:59 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:17:59 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:17:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:17:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0981c2c5-23aa-4190-b7ee-efea8a086a89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566, portal: 172.16.0.220,3260]
Apr 13 15:18:00 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566, portal: 172.16.0.220,3260] successful.
Apr 13 15:18:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb4a5d7-cce0-43cf-b5f1-e80dda0bacc2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e84a08-2e1f-4954-8064-52905dacabe3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:00 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:18:00 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:18:00 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:00 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:00 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:18:00 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:18:00 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:00 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcdf223-589b-4f01-ba58-7df2701d1974]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIEQTyxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:18:00 user nova-compute[71507]: WARNING nova.compute.manager [req-2cdd43f3-6752-4bf4-9e5b-87657ae0fbc6 req-f6f06772-1227-473c-b06e-970a255f351d service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state active and task_state rescuing.
Apr 13 15:18:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Instance destroyed successfully.
Apr 13 15:18:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Attempting rescue
Apr 13 15:18:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Instance directory exists: not creating {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 15:18:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Creating image(s)
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:18:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:18:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphtva464b/1c24e265fe29488a85ba7c75ced3528a.delta /opt/stack/data/nova/instances/snapshots/tmphtva464b/1c24e265fe29488a85ba7c75ced3528a {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue" returned: 0 in 0.073s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'migration_context' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Start _get_guest_xml network_info=[{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "vif_mac": "fa:16:3e:96:84:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'resources' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23766373438643533', 'path': '/dev/sdf'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766373438643533', 'path': '/dev/sdf'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:18:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:18:01 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'flavor' on Instance uuid 3dc146f3-9150-4920-b468-9aebcbc81162 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1194728092',display_name='tempest-ServerRescueNegativeTestJSON-server-1194728092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1194728092',id=21,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK5IRXy1iREs5DJGXQd5/AwCvP1NHbH7B+ioRYx7R5/k6QdMWuWbYssq6+iYLG0++tDjS55HcQeDhgUv/EqHbP9wKGTtL2gyMe13XKrxk7Yzy8UBwjPqj14R6xUkbKGdQ==',key_name='tempest-keypair-1516441123',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:16:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-cfhhwyv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=8b883f51-b15c-42d7-b71a-e80c11e7d77e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "vif_mac": "fa:16:3e:96:84:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "vif_mac": "fa:16:3e:96:84:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:84:55,bridge_name='br-int',has_traffic_filtering=True,id=6343df00-b9ef-49a6-be1e-69f12895910f,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6343df00-b9') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:18:01 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:18:01 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:18:01 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:18:01 user nova-compute[71507]:   <serial>73467274-8e1f-4536-9458-f3e619202566</serial>
Apr 13 15:18:01 user nova-compute[71507]: </disk>
Apr 13 15:18:01 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:18:01 user nova-compute[71507]:   <uuid>8b883f51-b15c-42d7-b71a-e80c11e7d77e</uuid>
Apr 13 15:18:01 user nova-compute[71507]:   <name>instance-00000015</name>
Apr 13 15:18:01 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:18:01 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:18:01 user nova-compute[71507]:   <metadata>
Apr 13 15:18:01 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:18:01 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:18:01 user nova-compute[71507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1194728092</nova:name>
Apr 13 15:18:01 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:18:01</nova:creationTime>
Apr 13 15:18:01 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:18:01 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:18:01 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:18:01 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:18:01 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:18:01 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:18:01 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:18:01 user nova-compute[71507]:       <nova:owner>
Apr 13 15:18:01 user nova-compute[71507]:         <nova:user uuid="c83940ddaaf64d94b40df9d00349aa91">tempest-ServerRescueNegativeTestJSON-66620130-project-member</nova:user>
Apr 13 15:18:01 user nova-compute[71507]:         <nova:project uuid="9bad96fcfa0d4691af2a7990ba9dbd09">tempest-ServerRescueNegativeTestJSON-66620130</nova:project>
Apr 13 15:18:01 user nova-compute[71507]:       </nova:owner>
Apr 13 15:18:01 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:18:01 user nova-compute[71507]:       <nova:ports>
Apr 13 15:18:01 user nova-compute[71507]:         <nova:port uuid="6343df00-b9ef-49a6-be1e-69f12895910f">
Apr 13 15:18:01 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 15:18:01 user nova-compute[71507]:         </nova:port>
Apr 13 15:18:01 user nova-compute[71507]:       </nova:ports>
Apr 13 15:18:01 user nova-compute[71507]:     </nova:instance>
Apr 13 15:18:01 user nova-compute[71507]:   </metadata>
Apr 13 15:18:01 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:18:01 user nova-compute[71507]:     <system>
Apr 13 15:18:01 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:18:01 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:18:01 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:18:01 user nova-compute[71507]:       <entry name="serial">8b883f51-b15c-42d7-b71a-e80c11e7d77e</entry>
Apr 13 15:18:01 user nova-compute[71507]:       <entry name="uuid">8b883f51-b15c-42d7-b71a-e80c11e7d77e</entry>
Apr 13 15:18:01 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:18:01 user nova-compute[71507]:     </system>
Apr 13 15:18:01 user nova-compute[71507]:   </sysinfo>
Apr 13 15:18:01 user nova-compute[71507]:   <os>
Apr 13 15:18:01 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:18:01 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:18:01 user nova-compute[71507]:   </os>
Apr 13 15:18:01 user nova-compute[71507]:   <features>
Apr 13 15:18:01 user nova-compute[71507]:     <acpi/>
Apr 13 15:18:01 user nova-compute[71507]:     <apic/>
Apr 13 15:18:01 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:18:01 user nova-compute[71507]:   </features>
Apr 13 15:18:01 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:18:01 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:18:01 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:18:01 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:18:01 user nova-compute[71507]:   </clock>
Apr 13 15:18:01 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:18:01 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:18:01 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:18:01 user nova-compute[71507]:   </cpu>
Apr 13 15:18:01 user nova-compute[71507]:   <devices>
Apr 13 15:18:01 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:18:01 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:18:01 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue"/>
Apr 13 15:18:01 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:18:01 user nova-compute[71507]:     </disk>
Apr 13 15:18:01 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:18:01 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:18:01 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk"/>
Apr 13 15:18:01 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:18:01 user nova-compute[71507]:     </disk>
Apr 13 15:18:01 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:18:01 user nova-compute[71507]:       <mac address="fa:16:3e:96:84:55"/>
Apr 13 15:18:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:18:01 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:18:01 user nova-compute[71507]:       <target dev="tap6343df00-b9"/>
Apr 13 15:18:01 user nova-compute[71507]:     </interface>
Apr 13 15:18:01 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:18:01 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/console.log" append="off"/>
Apr 13 15:18:01 user nova-compute[71507]:     </serial>
Apr 13 15:18:01 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:18:01 user nova-compute[71507]:     <video>
Apr 13 15:18:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:18:01 user nova-compute[71507]:     </video>
Apr 13 15:18:01 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:18:01 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:18:01 user nova-compute[71507]:     </rng>
Apr 13 15:18:01 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:18:01 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:18:01 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:18:01 user nova-compute[71507]:     </memballoon>
Apr 13 15:18:01 user nova-compute[71507]:   </devices>
Apr 13 15:18:01 user nova-compute[71507]: </domain>
Apr 13 15:18:01 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:18:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Instance destroyed successfully.
Apr 13 15:18:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphtva464b/1c24e265fe29488a85ba7c75ced3528a.delta /opt/stack/data/nova/instances/snapshots/tmphtva464b/1c24e265fe29488a85ba7c75ced3528a" returned: 0 in 0.353s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Snapshot extracted, beginning image upload
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] No VIF found with MAC fa:16:3e:96:84:55, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No VIF found with MAC fa:16:3e:fb:bb:a0, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b6c3e4db-41a3-42e4-9a33-2c6d21989c4d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.278s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:18:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:18:02 user nova-compute[71507]: WARNING nova.compute.manager [req-0595d2a4-a37e-4f76-a1d3-bb04ce4b95a8 req-96da7d1f-50d4-43da-a1a4-aad2e452e22f service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state active and task_state rescuing.
Apr 13 15:18:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:03 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Snapshot image upload complete
Apr 13 15:18:03 user nova-compute[71507]: INFO nova.compute.manager [None req-f0a6f5e9-f71a-4bb3-b07a-28b3588cdde7 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Took 4.95 seconds to snapshot the instance on the hypervisor.
Apr 13 15:18:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:18:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:18:04 user nova-compute[71507]: WARNING nova.compute.manager [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state active and task_state rescuing.
Apr 13 15:18:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:18:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:18:04 user nova-compute[71507]: WARNING nova.compute.manager [req-90dea0df-8978-48a7-a23c-cd551308e5ca req-7c50212a-42b8-4e94-a500-bfb5b093d7d5 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state active and task_state rescuing.
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for 8b883f51-b15c-42d7-b71a-e80c11e7d77e due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399085.185548, 8b883f51-b15c-42d7-b71a-e80c11e7d77e => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:18:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] VM Resumed (Lifecycle Event)
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f8831d8f-638c-4459-a070-c09b65792264 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:18:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399085.186715, 8b883f51-b15c-42d7-b71a-e80c11e7d77e => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:18:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] VM Started (Lifecycle Event)
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "77237c63-ee05-45ee-b9d7-a79deb5557d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:18:05 user nova-compute[71507]: INFO nova.compute.claims [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Claim successful on node user
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:18:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.policy [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:18:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Creating image(s)
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "/opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "/opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "/opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk 1073741824" returned: 0 in 0.050s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Cannot resize image /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'migration_context' on Instance uuid 77237c63-ee05-45ee-b9d7-a79deb5557d5 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Ensure instance console log exists: /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Successfully created port: 69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:18:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Successfully updated port: 69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:18:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "refresh_cache-77237c63-ee05-45ee-b9d7-a79deb5557d5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:18:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquired lock "refresh_cache-77237c63-ee05-45ee-b9d7-a79deb5557d5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:18:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:18:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received event network-changed-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:18:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Refreshing instance network info cache due to event network-changed-69f51766-5253-402e-8928-e02e0636e8fb. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:18:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] Acquiring lock "refresh_cache-77237c63-ee05-45ee-b9d7-a79deb5557d5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Updating instance_info_cache with network_info: [{"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Releasing lock "refresh_cache-77237c63-ee05-45ee-b9d7-a79deb5557d5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Instance network_info: |[{"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] Acquired lock "refresh_cache-77237c63-ee05-45ee-b9d7-a79deb5557d5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Refreshing network info cache for port 69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Start _get_guest_xml network_info=[{"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:18:08 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:18:08 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-610975501',display_name='tempest-AttachVolumeNegativeTest-server-610975501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-610975501',id=25,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEhJ8aRxcbt/b5bssHKvxbi2jC4AIY4T4hBEvKmj6R/j7wnUxuzLMRkfvDY3ug4A3Z/GvYHuFzNcKE9qqa0IWiS0M7i9r1KPJSEpqF4maidOFTbDofTAAXRjfFcQzNILw==',key_name='tempest-keypair-1037646861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-pfmihc3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:18:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=77237c63-ee05-45ee-b9d7-a79deb5557d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ef:ba,bridge_name='br-int',has_traffic_filtering=True,id=69f51766-5253-402e-8928-e02e0636e8fb,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f51766-52') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'pci_devices' on Instance uuid 77237c63-ee05-45ee-b9d7-a79deb5557d5 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:18:08 user nova-compute[71507]:   <uuid>77237c63-ee05-45ee-b9d7-a79deb5557d5</uuid>
Apr 13 15:18:08 user nova-compute[71507]:   <name>instance-00000019</name>
Apr 13 15:18:08 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:18:08 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:18:08 user nova-compute[71507]:   <metadata>
Apr 13 15:18:08 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:18:08 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:18:08 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeNegativeTest-server-610975501</nova:name>
Apr 13 15:18:08 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:18:08</nova:creationTime>
Apr 13 15:18:08 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:18:08 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:18:08 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:18:08 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:18:08 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:18:08 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:18:08 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:18:08 user nova-compute[71507]:       <nova:owner>
Apr 13 15:18:08 user nova-compute[71507]:         <nova:user uuid="fedd34ccc15c47f9a4fc96b080730acd">tempest-AttachVolumeNegativeTest-416139458-project-member</nova:user>
Apr 13 15:18:08 user nova-compute[71507]:         <nova:project uuid="3e3ba2d132c445039d0ae30ffd2bc64a">tempest-AttachVolumeNegativeTest-416139458</nova:project>
Apr 13 15:18:08 user nova-compute[71507]:       </nova:owner>
Apr 13 15:18:08 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:18:08 user nova-compute[71507]:       <nova:ports>
Apr 13 15:18:08 user nova-compute[71507]:         <nova:port uuid="69f51766-5253-402e-8928-e02e0636e8fb">
Apr 13 15:18:08 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 15:18:08 user nova-compute[71507]:         </nova:port>
Apr 13 15:18:08 user nova-compute[71507]:       </nova:ports>
Apr 13 15:18:08 user nova-compute[71507]:     </nova:instance>
Apr 13 15:18:08 user nova-compute[71507]:   </metadata>
Apr 13 15:18:08 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:18:08 user nova-compute[71507]:     <system>
Apr 13 15:18:08 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:18:08 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:18:08 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:18:08 user nova-compute[71507]:       <entry name="serial">77237c63-ee05-45ee-b9d7-a79deb5557d5</entry>
Apr 13 15:18:08 user nova-compute[71507]:       <entry name="uuid">77237c63-ee05-45ee-b9d7-a79deb5557d5</entry>
Apr 13 15:18:08 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:18:08 user nova-compute[71507]:     </system>
Apr 13 15:18:08 user nova-compute[71507]:   </sysinfo>
Apr 13 15:18:08 user nova-compute[71507]:   <os>
Apr 13 15:18:08 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:18:08 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:18:08 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:18:08 user nova-compute[71507]:   </os>
Apr 13 15:18:08 user nova-compute[71507]:   <features>
Apr 13 15:18:08 user nova-compute[71507]:     <acpi/>
Apr 13 15:18:08 user nova-compute[71507]:     <apic/>
Apr 13 15:18:08 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:18:08 user nova-compute[71507]:   </features>
Apr 13 15:18:08 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:18:08 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:18:08 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:18:08 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:18:08 user nova-compute[71507]:   </clock>
Apr 13 15:18:08 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:18:08 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:18:08 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:18:08 user nova-compute[71507]:   </cpu>
Apr 13 15:18:08 user nova-compute[71507]:   <devices>
Apr 13 15:18:08 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:18:08 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:18:08 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk"/>
Apr 13 15:18:08 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:18:08 user nova-compute[71507]:     </disk>
Apr 13 15:18:08 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:18:08 user nova-compute[71507]:       <mac address="fa:16:3e:08:ef:ba"/>
Apr 13 15:18:08 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:18:08 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:18:08 user nova-compute[71507]:       <target dev="tap69f51766-52"/>
Apr 13 15:18:08 user nova-compute[71507]:     </interface>
Apr 13 15:18:08 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:18:08 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/console.log" append="off"/>
Apr 13 15:18:08 user nova-compute[71507]:     </serial>
Apr 13 15:18:08 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:18:08 user nova-compute[71507]:     <video>
Apr 13 15:18:08 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:18:08 user nova-compute[71507]:     </video>
Apr 13 15:18:08 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:18:08 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:18:08 user nova-compute[71507]:     </rng>
Apr 13 15:18:08 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:18:08 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:18:08 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:18:08 user nova-compute[71507]:     </memballoon>
Apr 13 15:18:08 user nova-compute[71507]:   </devices>
Apr 13 15:18:08 user nova-compute[71507]: </domain>
Apr 13 15:18:08 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-610975501',display_name='tempest-AttachVolumeNegativeTest-server-610975501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-610975501',id=25,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEhJ8aRxcbt/b5bssHKvxbi2jC4AIY4T4hBEvKmj6R/j7wnUxuzLMRkfvDY3ug4A3Z/GvYHuFzNcKE9qqa0IWiS0M7i9r1KPJSEpqF4maidOFTbDofTAAXRjfFcQzNILw==',key_name='tempest-keypair-1037646861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-pfmihc3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:18:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=77237c63-ee05-45ee-b9d7-a79deb5557d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ef:ba,bridge_name='br-int',has_traffic_filtering=True,id=69f51766-5253-402e-8928-e02e0636e8fb,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f51766-52') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG os_vif [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ef:ba,bridge_name='br-int',has_traffic_filtering=True,id=69f51766-5253-402e-8928-e02e0636e8fb,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f51766-52') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69f51766-52, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69f51766-52, col_values=(('external_ids', {'iface-id': '69f51766-5253-402e-8928-e02e0636e8fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:ef:ba', 'vm-uuid': '77237c63-ee05-45ee-b9d7-a79deb5557d5'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:08 user nova-compute[71507]: INFO os_vif [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ef:ba,bridge_name='br-int',has_traffic_filtering=True,id=69f51766-5253-402e-8928-e02e0636e8fb,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f51766-52')
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No VIF found with MAC fa:16:3e:08:ef:ba, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Updated VIF entry in instance network info cache for port 69f51766-5253-402e-8928-e02e0636e8fb. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Updating instance_info_cache with network_info: [{"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:18:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-74d0f7c4-cdca-4043-b647-91227fdaa063 req-9036e91d-fd82-4454-9223-fb008260882a service nova] Releasing lock "refresh_cache-77237c63-ee05-45ee-b9d7-a79deb5557d5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received event network-vif-plugged-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] Acquiring lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] No waiting events found dispatching network-vif-plugged-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:18:10 user nova-compute[71507]: WARNING nova.compute.manager [req-7259095d-4535-4522-acfe-991221818989 req-ed4d7af5-6277-42a1-9a93-73ac880baf2b service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received unexpected event network-vif-plugged-69f51766-5253-402e-8928-e02e0636e8fb for instance with vm_state building and task_state spawning.
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399092.179403, 77237c63-ee05-45ee-b9d7-a79deb5557d5 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:18:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] VM Resumed (Lifecycle Event)
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:18:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Instance spawned successfully.
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:18:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399092.183466, 77237c63-ee05-45ee-b9d7-a79deb5557d5 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:18:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] VM Started (Lifecycle Event)
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:18:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:18:12 user nova-compute[71507]: INFO nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Took 5.99 seconds to spawn the instance on the hypervisor.
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received event network-vif-plugged-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] Acquiring lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] No waiting events found dispatching network-vif-plugged-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:18:12 user nova-compute[71507]: WARNING nova.compute.manager [req-6ca98496-0b32-4d7c-988b-c1957cec8788 req-0945d403-59a8-4a3d-b465-ad9f3a350ed7 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received unexpected event network-vif-plugged-69f51766-5253-402e-8928-e02e0636e8fb for instance with vm_state active and task_state None.
Apr 13 15:18:12 user nova-compute[71507]: INFO nova.compute.manager [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Took 6.84 seconds to build instance.
Apr 13 15:18:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5dee80c4-04bf-4e28-9f9c-b399493998ef tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.964s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:17 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances with incomplete migration  {{(pid=71507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 15:18:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:18 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:18:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:18:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:18:18 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:18:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updating instance_info_cache with network_info: [{"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:18:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:18:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:18:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 15:18:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] There are 0 instances to clean {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 15:18:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:27 user nova-compute[71507]: INFO nova.compute.manager [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Detaching volume 833def22-5680-4c24-9368-2130eefccdfc
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:27 user nova-compute[71507]: INFO nova.virt.block_device [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Attempting to driver detach volume 833def22-5680-4c24-9368-2130eefccdfc from mountpoint /dev/vdb
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Attempting to detach device vdb from instance 1aa74d14-db6f-41f5-b8af-32da312209d3 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:18:27 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:18:27 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:18:27 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:18:27 user nova-compute[71507]:   <serial>833def22-5680-4c24-9368-2130eefccdfc</serial>
Apr 13 15:18:27 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 15:18:27 user nova-compute[71507]: </disk>
Apr 13 15:18:27 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:27 user nova-compute[71507]: INFO nova.compute.manager [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Detaching volume f88a0575-31ac-45a6-a221-4fc8001fd857
Apr 13 15:18:27 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully detached device vdb from instance 1aa74d14-db6f-41f5-b8af-32da312209d3 from the persistent domain config.
Apr 13 15:18:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1aa74d14-db6f-41f5-b8af-32da312209d3 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:18:27 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:18:27 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:18:27 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:18:27 user nova-compute[71507]:   <serial>833def22-5680-4c24-9368-2130eefccdfc</serial>
Apr 13 15:18:27 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 15:18:27 user nova-compute[71507]: </disk>
Apr 13 15:18:27 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:18:27 user nova-compute[71507]: INFO nova.virt.block_device [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attempting to driver detach volume f88a0575-31ac-45a6-a221-4fc8001fd857 from mountpoint /dev/vdb
Apr 13 15:18:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Attempting to detach device vdb from instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:18:27 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:18:27 user nova-compute[71507]:   <source dev="/dev/sdd"/>
Apr 13 15:18:27 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:18:27 user nova-compute[71507]:   <serial>f88a0575-31ac-45a6-a221-4fc8001fd857</serial>
Apr 13 15:18:27 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 15:18:27 user nova-compute[71507]: </disk>
Apr 13 15:18:27 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:18:27 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully detached device vdb from instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 from the persistent domain config.
Apr 13 15:18:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:18:27 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:18:27 user nova-compute[71507]:   <source dev="/dev/sdd"/>
Apr 13 15:18:27 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:18:27 user nova-compute[71507]:   <serial>f88a0575-31ac-45a6-a221-4fc8001fd857</serial>
Apr 13 15:18:27 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 15:18:27 user nova-compute[71507]: </disk>
Apr 13 15:18:27 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399108.2211099, 1aa74d14-db6f-41f5-b8af-32da312209d3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully detached device vdb from instance 1aa74d14-db6f-41f5-b8af-32da312209d3 from the live domain config.
Apr 13 15:18:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIFDdulb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:18:28 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd0527b-f9ee-4966-9d2f-7bde04b3c825]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:18:28 user nova-compute[71507]: No targets found.
Apr 13 15:18:28 user nova-compute[71507]: iSNS:
Apr 13 15:18:28 user nova-compute[71507]: No targets found.
Apr 13 15:18:28 user nova-compute[71507]: STATIC:
Apr 13 15:18:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566
Apr 13 15:18:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:18:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:18:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc
Apr 13 15:18:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:18:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:18:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027
Apr 13 15:18:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:18:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:18:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:18:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:18:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:18:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857
Apr 13 15:18:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:18:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:18:28 user nova-compute[71507]: FIRMWARE:
Apr 13 15:18:28 user nova-compute[71507]: No targets found.
Apr 13 15:18:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:18:28 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:18:28 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b42075-815a-4ed0-9e74-647c131ba75d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[69062cdc-d698-4271-bb5f-be88240b9803]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c392b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd45ca0-f363-4003-b916-2cc89f3a4b59]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1038c867-841a-483d-9a86-72125938eaca]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[08936c87-66d9-4a9d-b1ae-869cd72b2858]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d0c33-a7f3-48da-bc6c-e454494244f4]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399108.526685, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:18:28 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully detached device vdb from instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 from the live domain config.
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a77e3f8-5f60-4550-8a73-5ab93c76feb2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgHULayo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:18:28 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[682133df-d21d-4f86-af7c-f6998e3fe406]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260]
Apr 13 15:18:28 user nova-compute[71507]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc, portal: 172.16.0.220,3260] successful.
Apr 13 15:18:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:833def22-5680-4c24-9368-2130eefccdfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2941de-cd7f-41b6-b55e-bb43747f94f9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== disconnect_volume: return (397ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.106s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[adead20e-f29b-49c4-88e4-63b9bd2e4f0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:18:28 user nova-compute[71507]: No targets found.
Apr 13 15:18:28 user nova-compute[71507]: iSNS:
Apr 13 15:18:28 user nova-compute[71507]: No targets found.
Apr 13 15:18:28 user nova-compute[71507]: STATIC:
Apr 13 15:18:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566
Apr 13 15:18:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:18:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:18:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027
Apr 13 15:18:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:18:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:18:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:18:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:18:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:18:28 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857
Apr 13 15:18:28 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:18:28 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:18:28 user nova-compute[71507]: FIRMWARE:
Apr 13 15:18:28 user nova-compute[71507]: No targets found.
Apr 13 15:18:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:18:28 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:18:28 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[12193a45-5eb3-4197-96a7-cf89b1d87afa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3721471d-95d5-4c49-9d1b-37b783c238af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:28 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c245ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857'): ({'sdd'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Removing single pathed devices sdd {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d3af2-065e-47aa-bfb5-02db3d03266c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b60507-e9b2-4973-858b-c3301cff2871]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flushing IO for device /dev/sdd {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[af47f652-54a9-4687-9676-3fd081a91460]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[975a9be4-c74a-48bd-ab50-e0546d936720]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[59289d65-f4c1-4aa1-abeb-cb020e3fda7a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eecb27-b7ad-41e6-bdf1-95cd180737b6]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260]
Apr 13 15:18:29 user nova-compute[71507]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857, portal: 172.16.0.220,3260] successful.
Apr 13 15:18:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88a0575-31ac-45a6-a221-4fc8001fd857 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c67aebc-35dd-4c04-afdf-a24ddf0b3e87]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== disconnect_volume: return (470ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e833c91d-c03f-483f-8e66-e4891179dd75 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.012s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'flavor' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71507) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b185ef20-e54c-40cc-a019-ea07bb4cdfae tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.160s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-unplugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-unplugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:18:31 user nova-compute[71507]: WARNING nova.compute.manager [req-511052a0-583d-49eb-94e0-a6ac7df6a804 req-4c878f97-8f26-4e7f-a268-ec386ad329f5 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-unplugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state active and task_state powering-off.
Apr 13 15:18:31 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance destroyed successfully.
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:18:31 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:18:31 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=26.014835357666016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cd789df6-0461-40e2-8510-a0a0d78b2fe8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.514s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 3dc146f3-9150-4920-b468-9aebcbc81162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing inventories for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating ProviderTree inventory for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing aggregate associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, aggregates: None {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 15:18:31 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing trait associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 15:18:32 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:18:32 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:18:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:18:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.867s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:18:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:18:32 user nova-compute[71507]: WARNING nova.compute.manager [req-4c88313f-0f3f-421b-b21a-f392cee0b02c req-8e6c3502-b28e-4777-9151-d18a98b7eb76 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state stopped and task_state None.
Apr 13 15:18:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:18:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:46 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399110.8262026, 1aa74d14-db6f-41f5-b8af-32da312209d3 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:18:46 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] VM Stopped (Lifecycle Event)
Apr 13 15:18:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-dcf179a9-4d52-4f6c-91c8-67b7a201c930 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:18:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-dcf179a9-4d52-4f6c-91c8-67b7a201c930 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:18:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:50 user nova-compute[71507]: DEBUG nova.objects.instance [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'flavor' on Instance uuid e1c4cb29-65fa-4b48-b7a2-cac613cb96fe {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:18:51 user nova-compute[71507]: INFO nova.compute.manager [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Attaching volume 11a7881b-efa3-43da-9fd0-3e26df187b17 to /dev/vdb
Apr 13 15:18:51 user nova-compute[71507]: DEBUG os_brick.utils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b33575-669e-432a-ba01-7ed9630321a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2601f94f-313e-423c-8268-ad5cb74a8a5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6545c1fc-1bdc-4bee-8f6a-fe8c76c6d74b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd9ed0c-7544-4655-b723-dc2877a56f9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:18:51 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:18:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e266ec1a-db78-4600-8ae8-b5ce709fc3c7]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG os_brick.utils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:18:51 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updating existing volume attachment record: b897c788-9449-4a1a-99c2-a616a757bd50 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:18:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:18:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:18:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:18:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:18:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zowCdWuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:18:55 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:18:55 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:18:55 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[66380c40-575e-4607-857c-1466a2aca9d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:18:55 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac8ecf3-06b3-48c9-910f-a8c2f6956fc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17] added
Apr 13 15:18:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f998eb73-bfb4-45bf-a2a1-dae1c004b45f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf03a81-3310-47cf-acea-6316a832f35d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zowCdWuO {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zowCdWuO" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e3ce1e-478b-46bf-9d0a-af18d35f0048]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zowCdWuO'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0122bbcd-80f8-4177-b394-226a2ff5d59c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3c276c-efc4-4de8-8a03-ba031179b0c6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a7de9b-1398-4a50-8eab-2abf045b79da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17, portal: 172.16.0.220,3260]
Apr 13 15:18:55 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17, portal: 172.16.0.220,3260] successful.
Apr 13 15:18:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d369370-723e-47dc-848e-1dc0a060a8e1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cf1e7b-0298-48b7-9510-03172c4b7966]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:18:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[91126eb5-2bc3-4655-a929-143ced62bd0d]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:18:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zowCdWuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:18:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:18:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23231313337373639', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:18:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231313337373639', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:18:56 user nova-compute[71507]: DEBUG nova.objects.instance [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'flavor' on Instance uuid e1c4cb29-65fa-4b48-b7a2-cac613cb96fe {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:18:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:18:56 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:18:56 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:18:56 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:18:56 user nova-compute[71507]:   <serial>11a7881b-efa3-43da-9fd0-3e26df187b17</serial>
Apr 13 15:18:56 user nova-compute[71507]: </disk>
Apr 13 15:18:56 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:18:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:18:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:18:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] No VIF found with MAC fa:16:3e:a5:0d:f6, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:18:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8e33748a-a653-41b0-a710-1e3008f6e274 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.369s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:18:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:18:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing instance network info cache due to event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:19:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] Acquiring lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:19:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] Acquired lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:19:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:19:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updated VIF entry in instance network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:19:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updating instance_info_cache with network_info: [{"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:19:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d9b261ba-b3d5-4025-a106-42bac3fd4330 req-399cb4e4-91a9-4040-aa28-1e66b196c56f service nova] Releasing lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing instance network info cache due to event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] Acquiring lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] Acquired lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:02 user nova-compute[71507]: INFO nova.compute.manager [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Rebooting instance
Apr 13 15:19:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updated VIF entry in instance network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updating instance_info_cache with network_info: [{"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-388e0382-42c3-43af-be7c-c5118c31b879 req-d96697ee-fcc3-4f6e-869b-fd058401ba9d service nova] Releasing lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquired lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:19:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:03 user nova-compute[71507]: DEBUG nova.network.neutron [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updating instance_info_cache with network_info: [{"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:19:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Releasing lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:19:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:19:05 user nova-compute[71507]: INFO nova.compute.claims [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Claim successful on node user
Apr 13 15:19:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-unplugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] No waiting events found dispatching network-vif-unplugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:05 user nova-compute[71507]: WARNING nova.compute.manager [req-026d8082-7ca2-4bbf-9a2a-254ff68331e3 req-c8f43367-71aa-42c3-8743-61b28ba79eba service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received unexpected event network-vif-unplugged-df99421e-bdc6-4fe5-9865-823bcb128ccc for instance with vm_state active and task_state reboot_started.
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:19:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:19:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:19:06 user nova-compute[71507]: INFO nova.virt.block_device [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Booting with volume-backed-image 90e5cdd0-62b7-441b-9971-cfa8e8a0478d at /dev/vda
Apr 13 15:19:06 user nova-compute[71507]: DEBUG nova.policy [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75bf6e19993f4c2e90fd52c4d6212622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240b28f42732478ba732994b2c9e3fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:19:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Instance shutdown successfully.
Apr 13 15:19:06 user nova-compute[71507]: DEBUG nova.network.neutron [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Successfully created port: 92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Successfully updated port: 92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquired lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] No waiting events found dispatching network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:07 user nova-compute[71507]: WARNING nova.compute.manager [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received unexpected event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc for instance with vm_state active and task_state reboot_started.
Apr 13 15:19:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-changed-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Refreshing instance network info cache due to event network-changed-92d492eb-f3b6-4481-b492-949cf7eabd1a. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Acquiring lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:19:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG nova.network.neutron [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Updating instance_info_cache with network_info: [{"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Releasing lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Instance network_info: |[{"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Acquired lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Refreshing network info cache for port 92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.network.neutron [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Updated VIF entry in instance network info cache for port 92d492eb-f3b6-4481-b492-949cf7eabd1a. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.network.neutron [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Updating instance_info_cache with network_info: [{"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1834ff79-7f8b-469e-99d8-3b6a0e90e974 req-81872647-82c9-4a41-9fc9-ac6dd5179038 service nova] Releasing lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for e1c4cb29-65fa-4b48-b7a2-cac613cb96fe due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399149.8262136, e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:19:09 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] VM Resumed (Lifecycle Event)
Apr 13 15:19:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Instance running successfully.
Apr 13 15:19:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Instance soft rebooted successfully.
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] No waiting events found dispatching network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:09 user nova-compute[71507]: WARNING nova.compute.manager [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received unexpected event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc for instance with vm_state active and task_state reboot_started.
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] No waiting events found dispatching network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:09 user nova-compute[71507]: WARNING nova.compute.manager [req-f066af64-015a-4e6c-b691-f2c202e1314b req-0aff2a9e-ed54-4ef7-a28e-b76af598b2ba service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received unexpected event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc for instance with vm_state active and task_state reboot_started.
Apr 13 15:19:09 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399149.831435, e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:19:09 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] VM Started (Lifecycle Event)
Apr 13 15:19:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-52a521c1-2a10-4335-972e-29bcd281199b tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.424s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG os_brick.utils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[737a06c2-72ea-4817-a873-c94d60694da5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb26d14f-73ec-4fe8-959c-b9781d4b447f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bc854d-a3b3-4ac2-9945-6fa07752aba7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ff79e0-05f5-4ef9-8218-c9d7fcf49a49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:19:11 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:19:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7aa2cd-47d4-4508-bb40-80a0dfa7f571]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG os_brick.utils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:19:11 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Updating existing volume attachment record: dbb2661e-b94f-4754-96f9-5ef5018ed155 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:19:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:19:16 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Creating image(s)
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Ensure instance console log exists: /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Start _get_guest_xml network_info=[{"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnmljsyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c609c1d1-edcf-4b71-abea-5dd95ebcd81f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2a3847f-ce95-4277-be5b-0a4becc7711c', 'serial': 'c2a3847f-ce95-4277-be5b-0a4becc7711c'}, 'attachment_id': 'dbb2661e-b94f-4754-96f9-5ef5018ed155', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:19:16 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:19:16 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnmljsyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:19:16 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:19:16 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:19:16 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d97a4-187c-496e-b0ce-94bfaa13a0d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:19:16 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c5b25b-3c95-41f8-975d-63ec20b925b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c] added
Apr 13 15:19:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a40ed4e-9146-4cbd-b76b-8b15a4dbf854]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[969cec90-8f5e-4e9e-a83b-c870b234978c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnmljsyO {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnmljsyO" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57d5f83-750c-44e5-9571-7235e739610b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GnmljsyO'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b9355f-ef84-4af4-9121-2b178f178e36]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb1e14c-249c-4c90-9c31-1fd6dbe36c05]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[43be5f73-6d27-4966-ba1e-4c83885e28e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c, portal: 172.16.0.220,3260]
Apr 13 15:19:16 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c, portal: 172.16.0.220,3260] successful.
Apr 13 15:19:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb2f965-9ca2-4dd5-90be-6f4b9d5eb86f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84b20a3-d480-45e8-9a2c-d2b10ddbb5c4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:19:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:19:16 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:19:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[563af5a5-4d6e-45dc-bf40-3b796f0a58b3]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:19:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnmljsyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26564303632623336', 'path': '/dev/sdd'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564303632623336', 'path': '/dev/sdd'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82933329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82933329',id=26,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-mpki9sme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:19:06Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=c609c1d1-edcf-4b71-abea-5dd95ebcd81f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:51:fe,bridge_name='br-int',has_traffic_filtering=True,id=92d492eb-f3b6-4481-b492-949cf7eabd1a,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d492eb-f3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.objects.instance [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'pci_devices' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:19:17 user nova-compute[71507]:   <uuid>c609c1d1-edcf-4b71-abea-5dd95ebcd81f</uuid>
Apr 13 15:19:17 user nova-compute[71507]:   <name>instance-0000001a</name>
Apr 13 15:19:17 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:19:17 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:19:17 user nova-compute[71507]:   <metadata>
Apr 13 15:19:17 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:19:17 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:19:17 user nova-compute[71507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-82933329</nova:name>
Apr 13 15:19:17 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:19:16</nova:creationTime>
Apr 13 15:19:17 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:19:17 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:19:17 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:19:17 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:19:17 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:19:17 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:19:17 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:19:17 user nova-compute[71507]:       <nova:owner>
Apr 13 15:19:17 user nova-compute[71507]:         <nova:user uuid="75bf6e19993f4c2e90fd52c4d6212622">tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member</nova:user>
Apr 13 15:19:17 user nova-compute[71507]:         <nova:project uuid="240b28f42732478ba732994b2c9e3fbe">tempest-ServerBootFromVolumeStableRescueTest-1009244781</nova:project>
Apr 13 15:19:17 user nova-compute[71507]:       </nova:owner>
Apr 13 15:19:17 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:19:17 user nova-compute[71507]:       <nova:ports>
Apr 13 15:19:17 user nova-compute[71507]:         <nova:port uuid="92d492eb-f3b6-4481-b492-949cf7eabd1a">
Apr 13 15:19:17 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 15:19:17 user nova-compute[71507]:         </nova:port>
Apr 13 15:19:17 user nova-compute[71507]:       </nova:ports>
Apr 13 15:19:17 user nova-compute[71507]:     </nova:instance>
Apr 13 15:19:17 user nova-compute[71507]:   </metadata>
Apr 13 15:19:17 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:19:17 user nova-compute[71507]:     <system>
Apr 13 15:19:17 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:19:17 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:19:17 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:19:17 user nova-compute[71507]:       <entry name="serial">c609c1d1-edcf-4b71-abea-5dd95ebcd81f</entry>
Apr 13 15:19:17 user nova-compute[71507]:       <entry name="uuid">c609c1d1-edcf-4b71-abea-5dd95ebcd81f</entry>
Apr 13 15:19:17 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:19:17 user nova-compute[71507]:     </system>
Apr 13 15:19:17 user nova-compute[71507]:   </sysinfo>
Apr 13 15:19:17 user nova-compute[71507]:   <os>
Apr 13 15:19:17 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:19:17 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:19:17 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:19:17 user nova-compute[71507]:   </os>
Apr 13 15:19:17 user nova-compute[71507]:   <features>
Apr 13 15:19:17 user nova-compute[71507]:     <acpi/>
Apr 13 15:19:17 user nova-compute[71507]:     <apic/>
Apr 13 15:19:17 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:19:17 user nova-compute[71507]:   </features>
Apr 13 15:19:17 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:19:17 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:19:17 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:19:17 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:19:17 user nova-compute[71507]:   </clock>
Apr 13 15:19:17 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:19:17 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:19:17 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:19:17 user nova-compute[71507]:   </cpu>
Apr 13 15:19:17 user nova-compute[71507]:   <devices>
Apr 13 15:19:17 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:19:17 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:19:17 user nova-compute[71507]:       <source dev="/dev/sdd"/>
Apr 13 15:19:17 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:19:17 user nova-compute[71507]:       <serial>c2a3847f-ce95-4277-be5b-0a4becc7711c</serial>
Apr 13 15:19:17 user nova-compute[71507]:     </disk>
Apr 13 15:19:17 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:19:17 user nova-compute[71507]:       <mac address="fa:16:3e:e2:51:fe"/>
Apr 13 15:19:17 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:19:17 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:19:17 user nova-compute[71507]:       <target dev="tap92d492eb-f3"/>
Apr 13 15:19:17 user nova-compute[71507]:     </interface>
Apr 13 15:19:17 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:19:17 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/console.log" append="off"/>
Apr 13 15:19:17 user nova-compute[71507]:     </serial>
Apr 13 15:19:17 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:19:17 user nova-compute[71507]:     <video>
Apr 13 15:19:17 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:19:17 user nova-compute[71507]:     </video>
Apr 13 15:19:17 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:19:17 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:19:17 user nova-compute[71507]:     </rng>
Apr 13 15:19:17 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:19:17 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:19:17 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:19:17 user nova-compute[71507]:     </memballoon>
Apr 13 15:19:17 user nova-compute[71507]:   </devices>
Apr 13 15:19:17 user nova-compute[71507]: </domain>
Apr 13 15:19:17 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82933329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82933329',id=26,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-mpki9sme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:19:06Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=c609c1d1-edcf-4b71-abea-5dd95ebcd81f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:51:fe,bridge_name='br-int',has_traffic_filtering=True,id=92d492eb-f3b6-4481-b492-949cf7eabd1a,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d492eb-f3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG os_vif [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:51:fe,bridge_name='br-int',has_traffic_filtering=True,id=92d492eb-f3b6-4481-b492-949cf7eabd1a,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d492eb-f3') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92d492eb-f3, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92d492eb-f3, col_values=(('external_ids', {'iface-id': '92d492eb-f3b6-4481-b492-949cf7eabd1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:51:fe', 'vm-uuid': 'c609c1d1-edcf-4b71-abea-5dd95ebcd81f'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:17 user nova-compute[71507]: INFO os_vif [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:51:fe,bridge_name='br-int',has_traffic_filtering=True,id=92d492eb-f3b6-4481-b492-949cf7eabd1a,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d492eb-f3')
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No VIF found with MAC fa:16:3e:e2:51:fe, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:19:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:18 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:19:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:19:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:19:18 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance_info_cache with network_info: [{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG nova.compute.manager [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:19 user nova-compute[71507]: DEBUG nova.compute.manager [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:19 user nova-compute[71507]: WARNING nova.compute.manager [req-30ebdc90-9667-4361-988b-6f26f4ad4b2c req-9c28a7c9-2e12-4700-9a08-046fcb0a1e6a service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state building and task_state spawning.
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399161.3864033, c609c1d1-edcf-4b71-abea-5dd95ebcd81f => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:19:21 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] VM Resumed (Lifecycle Event)
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:19:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Instance spawned successfully.
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:19:21 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399161.3901203, c609c1d1-edcf-4b71-abea-5dd95ebcd81f => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:19:21 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] VM Started (Lifecycle Event)
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:19:21 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:19:21 user nova-compute[71507]: INFO nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Took 5.11 seconds to spawn the instance on the hypervisor.
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:21 user nova-compute[71507]: WARNING nova.compute.manager [req-705c3c65-37e4-44e9-929b-0236a928f65e req-c1e0a4ef-3187-4b89-a827-5e6f64ee1366 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state building and task_state spawning.
Apr 13 15:19:21 user nova-compute[71507]: INFO nova.compute.manager [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Took 16.22 seconds to build instance.
Apr 13 15:19:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-eefca9f9-5121-40e3-9bf0-b5fa25541ca6 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.323s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:19:31 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:19:31 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7747MB free_disk=26.010944366455078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 3dc146f3-9150-4920-b468-9aebcbc81162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 77237c63-ee05-45ee-b9d7-a79deb5557d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:19:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:19:32 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:19:32 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:19:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:19:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:19:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:50 user nova-compute[71507]: INFO nova.compute.manager [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Unrescuing
Apr 13 15:19:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:19:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquired lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:19:50 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:19:50 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updating instance_info_cache with network_info: [{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:19:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Releasing lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:19:50 user nova-compute[71507]: DEBUG nova.objects.instance [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'flavor' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:19:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:51 user nova-compute[71507]: WARNING nova.compute.manager [req-d57f175e-f967-4c6d-bf14-25d2e558ee6c req-1c3cadb8-1f6d-408b-bd63-82d597a43886 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Instance destroyed successfully.
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:53 user nova-compute[71507]: WARNING nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:53 user nova-compute[71507]: WARNING nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:53 user nova-compute[71507]: WARNING nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:53 user nova-compute[71507]: WARNING nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:53 user nova-compute[71507]: WARNING nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:53 user nova-compute[71507]: WARNING nova.compute.manager [req-1a372114-efae-4714-8a0b-092a8202d8a2 req-d6d804b7-748b-4137-a9ef-e75318fa8af1 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for 8b883f51-b15c-42d7-b71a-e80c11e7d77e due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399195.0094972, 8b883f51-b15c-42d7-b71a-e80c11e7d77e => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:19:55 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] VM Resumed (Lifecycle Event)
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8bb72cb3-47b2-4b82-8bcf-b8635b380d44 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:19:55 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399195.0121284, 8b883f51-b15c-42d7-b71a-e80c11e7d77e => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:19:55 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] VM Started (Lifecycle Event)
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:55 user nova-compute[71507]: WARNING nova.compute.manager [req-f0d0e3c2-16a0-4a26-aa51-0c16bc884c0a req-318128f1-c36a-4eb0-aa6e-6ee363d4911c service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state active and task_state None.
Apr 13 15:19:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received event network-changed-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Refreshing instance network info cache due to event network-changed-69f51766-5253-402e-8928-e02e0636e8fb. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] Acquiring lock "refresh_cache-77237c63-ee05-45ee-b9d7-a79deb5557d5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] Acquired lock "refresh_cache-77237c63-ee05-45ee-b9d7-a79deb5557d5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Refreshing network info cache for port 69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "77237c63-ee05-45ee-b9d7-a79deb5557d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:56 user nova-compute[71507]: INFO nova.compute.manager [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Terminating instance
Apr 13 15:19:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received event network-vif-unplugged-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] Acquiring lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] No waiting events found dispatching network-vif-unplugged-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-8e1f3a05-f62f-4b62-a44f-b99250dcfdcc req-ac9436d0-ae2d-4a58-9c4f-cbeee708a4cf service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received event network-vif-unplugged-69f51766-5253-402e-8928-e02e0636e8fb for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Updated VIF entry in instance network info cache for port 69f51766-5253-402e-8928-e02e0636e8fb. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Updating instance_info_cache with network_info: [{"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:19:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0bc681ec-1c28-4ebe-93f3-db99cc407bc8 req-9a5bc886-05ac-46f0-b71e-56c931572289 service nova] Releasing lock "refresh_cache-77237c63-ee05-45ee-b9d7-a79deb5557d5" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Instance destroyed successfully.
Apr 13 15:19:57 user nova-compute[71507]: DEBUG nova.objects.instance [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'resources' on Instance uuid 77237c63-ee05-45ee-b9d7-a79deb5557d5 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-610975501',display_name='tempest-AttachVolumeNegativeTest-server-610975501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-610975501',id=25,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEhJ8aRxcbt/b5bssHKvxbi2jC4AIY4T4hBEvKmj6R/j7wnUxuzLMRkfvDY3ug4A3Z/GvYHuFzNcKE9qqa0IWiS0M7i9r1KPJSEpqF4maidOFTbDofTAAXRjfFcQzNILw==',key_name='tempest-keypair-1037646861',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-pfmihc3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=77237c63-ee05-45ee-b9d7-a79deb5557d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "69f51766-5253-402e-8928-e02e0636e8fb", "address": "fa:16:3e:08:ef:ba", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f51766-52", "ovs_interfaceid": "69f51766-5253-402e-8928-e02e0636e8fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ef:ba,bridge_name='br-int',has_traffic_filtering=True,id=69f51766-5253-402e-8928-e02e0636e8fb,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f51766-52') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG os_vif [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ef:ba,bridge_name='br-int',has_traffic_filtering=True,id=69f51766-5253-402e-8928-e02e0636e8fb,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f51766-52') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69f51766-52, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:57 user nova-compute[71507]: INFO os_vif [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ef:ba,bridge_name='br-int',has_traffic_filtering=True,id=69f51766-5253-402e-8928-e02e0636e8fb,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f51766-52')
Apr 13 15:19:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Deleting instance files /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5_del
Apr 13 15:19:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Deletion of /opt/stack/data/nova/instances/77237c63-ee05-45ee-b9d7-a79deb5557d5_del complete
Apr 13 15:19:57 user nova-compute[71507]: INFO nova.compute.manager [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 15:19:57 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:19:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:19:58 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:19:58 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Took 0.81 seconds to deallocate network for instance.
Apr 13 15:19:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-eaa5606c-2ea5-4166-9522-7248b0628bbf req-3dd2c1c7-1dc6-4130-9294-3a10771318b5 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received event network-vif-deleted-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:58 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:19:58 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:19:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:58 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Deleted allocations for instance 77237c63-ee05-45ee-b9d7-a79deb5557d5
Apr 13 15:19:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-592a3e4b-f815-46cd-a344-cdaeb30d0951 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.304s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:59 user nova-compute[71507]: DEBUG nova.compute.manager [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received event network-vif-plugged-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:19:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] Acquiring lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:19:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:19:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] Lock "77237c63-ee05-45ee-b9d7-a79deb5557d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:19:59 user nova-compute[71507]: DEBUG nova.compute.manager [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] No waiting events found dispatching network-vif-plugged-69f51766-5253-402e-8928-e02e0636e8fb {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:19:59 user nova-compute[71507]: WARNING nova.compute.manager [req-6a3b6985-a618-4b69-8862-2ff7c2ed081c req-5a246656-d973-45dc-baf8-94e63d730eb3 service nova] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Received unexpected event network-vif-plugged-69f51766-5253-402e-8928-e02e0636e8fb for instance with vm_state deleted and task_state None.
Apr 13 15:20:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:20:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:12 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399197.3749337, 77237c63-ee05-45ee-b9d7-a79deb5557d5 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:20:12 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] VM Stopped (Lifecycle Event)
Apr 13 15:20:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1f500308-f33a-4654-83a6-83cfd3b123ec None None] [instance: 77237c63-ee05-45ee-b9d7-a79deb5557d5] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:20:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:18 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:20:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:20:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:20:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:20:18 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:20:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updating instance_info_cache with network_info: [{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:20:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:20:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG nova.objects.instance [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'flavor' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquired lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'info_cache' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:20 user nova-compute[71507]: INFO nova.compute.manager [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attaching volume 23e2b917-2efe-4a44-8c06-1a70d0c6d09f to /dev/vdb
Apr 13 15:20:20 user nova-compute[71507]: DEBUG os_brick.utils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a82b8c-0d72-4807-8ce7-00448e9c85cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb5b2e1-a80d-49a4-9485-5ddf13e358ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe326d1-494e-4ff0-8884-5222b6069f5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0216329-57c8-4413-b3f5-d92cdb0ace6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:20:20 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:20:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b20ad-e376-4292-a85f-3b72e0af8a9a]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG os_brick.utils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:20:20 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating existing volume attachment record: b2073532-28da-4154-a342-2c75e2277063 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updating instance_info_cache with network_info: [{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Releasing lock "refresh_cache-1aa74d14-db6f-41f5-b8af-32da312209d3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:20:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance destroyed successfully.
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'resources' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1504684221',display_name='tempest-AttachVolumeTestJSON-server-1504684221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1504684221',id=18,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w==',key_name='tempest-keypair-668401822',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-0f5qbue4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:18:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=1aa74d14-db6f-41f5-b8af-32da312209d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG os_vif [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84611f06-d6, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:20:21 user nova-compute[71507]: INFO os_vif [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6')
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Start _get_guest_xml network_info=[{"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'numa_topology' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:21 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:20:21 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1504684221',display_name='tempest-AttachVolumeTestJSON-server-1504684221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1504684221',id=18,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w==',key_name='tempest-keypair-668401822',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-0f5qbue4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:18:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=1aa74d14-db6f-41f5-b8af-32da312209d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:20:21 user nova-compute[71507]:   <uuid>1aa74d14-db6f-41f5-b8af-32da312209d3</uuid>
Apr 13 15:20:21 user nova-compute[71507]:   <name>instance-00000012</name>
Apr 13 15:20:21 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:20:21 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:20:21 user nova-compute[71507]:   <metadata>
Apr 13 15:20:21 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:20:21 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:20:21 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeTestJSON-server-1504684221</nova:name>
Apr 13 15:20:21 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:20:21</nova:creationTime>
Apr 13 15:20:21 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:20:21 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:20:21 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:20:21 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:20:21 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:20:21 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:20:21 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:20:21 user nova-compute[71507]:       <nova:owner>
Apr 13 15:20:21 user nova-compute[71507]:         <nova:user uuid="de1a698b103a47c0b2864eef54be648b">tempest-AttachVolumeTestJSON-157319562-project-member</nova:user>
Apr 13 15:20:21 user nova-compute[71507]:         <nova:project uuid="ceba33821a9b4f7aa81c2857c11261f1">tempest-AttachVolumeTestJSON-157319562</nova:project>
Apr 13 15:20:21 user nova-compute[71507]:       </nova:owner>
Apr 13 15:20:21 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:20:21 user nova-compute[71507]:       <nova:ports>
Apr 13 15:20:21 user nova-compute[71507]:         <nova:port uuid="84611f06-d6ca-49e1-afe7-7723921e62dc">
Apr 13 15:20:21 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 15:20:21 user nova-compute[71507]:         </nova:port>
Apr 13 15:20:21 user nova-compute[71507]:       </nova:ports>
Apr 13 15:20:21 user nova-compute[71507]:     </nova:instance>
Apr 13 15:20:21 user nova-compute[71507]:   </metadata>
Apr 13 15:20:21 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:20:21 user nova-compute[71507]:     <system>
Apr 13 15:20:21 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:20:21 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:20:21 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:20:21 user nova-compute[71507]:       <entry name="serial">1aa74d14-db6f-41f5-b8af-32da312209d3</entry>
Apr 13 15:20:21 user nova-compute[71507]:       <entry name="uuid">1aa74d14-db6f-41f5-b8af-32da312209d3</entry>
Apr 13 15:20:21 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:20:21 user nova-compute[71507]:     </system>
Apr 13 15:20:21 user nova-compute[71507]:   </sysinfo>
Apr 13 15:20:21 user nova-compute[71507]:   <os>
Apr 13 15:20:21 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:20:21 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:20:21 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:20:21 user nova-compute[71507]:   </os>
Apr 13 15:20:21 user nova-compute[71507]:   <features>
Apr 13 15:20:21 user nova-compute[71507]:     <acpi/>
Apr 13 15:20:21 user nova-compute[71507]:     <apic/>
Apr 13 15:20:21 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:20:21 user nova-compute[71507]:   </features>
Apr 13 15:20:21 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:20:21 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:20:21 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:20:21 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:20:21 user nova-compute[71507]:   </clock>
Apr 13 15:20:21 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:20:21 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:20:21 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:20:21 user nova-compute[71507]:   </cpu>
Apr 13 15:20:21 user nova-compute[71507]:   <devices>
Apr 13 15:20:21 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:20:21 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:20:21 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk"/>
Apr 13 15:20:21 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:20:21 user nova-compute[71507]:     </disk>
Apr 13 15:20:21 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:20:21 user nova-compute[71507]:       <mac address="fa:16:3e:a3:4a:01"/>
Apr 13 15:20:21 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:20:21 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:20:21 user nova-compute[71507]:       <target dev="tap84611f06-d6"/>
Apr 13 15:20:21 user nova-compute[71507]:     </interface>
Apr 13 15:20:21 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:20:21 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/console.log" append="off"/>
Apr 13 15:20:21 user nova-compute[71507]:     </serial>
Apr 13 15:20:21 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:20:21 user nova-compute[71507]:     <video>
Apr 13 15:20:21 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:20:21 user nova-compute[71507]:     </video>
Apr 13 15:20:21 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:20:21 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:20:21 user nova-compute[71507]:     </rng>
Apr 13 15:20:21 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:20:21 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:20:21 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:20:21 user nova-compute[71507]:     </memballoon>
Apr 13 15:20:21 user nova-compute[71507]:   </devices>
Apr 13 15:20:21 user nova-compute[71507]: </domain>
Apr 13 15:20:21 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Cannot resize image /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'migration_context' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1504684221',display_name='tempest-AttachVolumeTestJSON-server-1504684221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1504684221',id=18,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w==',key_name='tempest-keypair-668401822',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-0f5qbue4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:18:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=1aa74d14-db6f-41f5-b8af-32da312209d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG os_vif [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84611f06-d6, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84611f06-d6, col_values=(('external_ids', {'iface-id': '84611f06-d6ca-49e1-afe7-7723921e62dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:4a:01', 'vm-uuid': '1aa74d14-db6f-41f5-b8af-32da312209d3'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:20:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:21 user nova-compute[71507]: INFO os_vif [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6')
Apr 13 15:20:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:20:23 user nova-compute[71507]: WARNING nova.compute.manager [req-d2ab7b21-9bfd-4eee-bd7c-a79344831efc req-16251906-09b6-4b53-ad85-728c5f09fdf9 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state stopped and task_state powering-on.
Apr 13 15:20:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:20:25 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:20:25 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:20:25 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9edbcc-9449-4758-9c54-5ef49cccc7bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:20:25 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[be63a08a-3e61-4868-b898-d71f8fada0aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f] added
Apr 13 15:20:25 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffef4ef7-f34a-4b01-b0b2-ed1e369aa482]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce57cfe5-4f24-4caf-9b92-d396a0045a9b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXpRLefv {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXpRLefv" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5391adf0-d3b4-4713-9c44-f8543c349e36]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXpRLefv'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd463b5-147d-4d37-a83c-39d07a29a80e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5726bedb-f99b-4569-8ce4-8f017ed356d4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:25 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:25 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c17affb-d18b-4596-ba1e-782c7ac781b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]
Apr 13 15:20:25 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.
Apr 13 15:20:25 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[331b5cff-1d43-4d0b-b6aa-a9a22547f0b4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a6454-3004-4467-89d1-f15960ef033d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:25 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:25 user nova-compute[71507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:25 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399225.44029, 1aa74d14-db6f-41f5-b8af-32da312209d3 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:20:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] VM Resumed (Lifecycle Event)
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb340c27-076b-47ff-90f4-016b5ddeb6ae]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:20:25 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance rebooted successfully.
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5d21bc95-252c-4dc5-a8b8-2d2febf79421 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:20:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399225.444924, 1aa74d14-db6f-41f5-b8af-32da312209d3 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:20:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] VM Started (Lifecycle Event)
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:20:25 user nova-compute[71507]: WARNING nova.compute.manager [req-c92f8dc3-3681-48d1-b217-6b087e9f6675 req-af694eae-0448-4a44-9972-d70fac5ed976 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state active and task_state None.
Apr 13 15:20:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23862346631373431', 'path': '/dev/sdg'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862346631373431', 'path': '/dev/sdg'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG nova.objects.instance [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'flavor' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:20:26 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:20:26 user nova-compute[71507]:   <source dev="/dev/sdg"/>
Apr 13 15:20:26 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:20:26 user nova-compute[71507]:   <serial>23e2b917-2efe-4a44-8c06-1a70d0c6d09f</serial>
Apr 13 15:20:26 user nova-compute[71507]: </disk>
Apr 13 15:20:26 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:20:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No VIF found with MAC fa:16:3e:f7:02:ec, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:20:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dc139fa-4eea-48fd-87ff-e709d05378d7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.430s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:27 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:20:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:27 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:20:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Stashing vm_state: active {{(pid=71507) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'pci_requests' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:20:29 user nova-compute[71507]: INFO nova.compute.claims [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Claim successful on node user
Apr 13 15:20:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'resources' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'pci_devices' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:30 user nova-compute[71507]: INFO nova.compute.resource_tracker [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating resource usage from migration 99dd52ce-1c03-4b59-b1a2-872bc1613000
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.682s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:30 user nova-compute[71507]: INFO nova.compute.manager [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Migrating
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:30 user nova-compute[71507]: INFO nova.compute.rpcapi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG nova.network.neutron [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:20:31 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:20:31 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7781MB free_disk=26.046707153320312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Applying migration context for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 as it has an incoming, in-progress migration 99dd52ce-1c03-4b59-b1a2-872bc1613000. Migration status is pre-migrating {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 15:20:31 user nova-compute[71507]: INFO nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating resource usage from migration 99dd52ce-1c03-4b59-b1a2-872bc1613000
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 3dc146f3-9150-4920-b468-9aebcbc81162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Migration 99dd52ce-1c03-4b59-b1a2-872bc1613000 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG nova.network.neutron [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance_info_cache with network_info: [{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Starting migrate_disk_and_power_off {{(pid=71507) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.154s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:20:32 user nova-compute[71507]: WARNING nova.compute.manager [req-75cdaaa7-6210-456b-bf9d-8c0209134170 req-98feb163-a354-4bcf-b5b6-4083feb83c7b service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state active and task_state resize_migrating.
Apr 13 15:20:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance destroyed successfully.
Apr 13 15:20:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:f7:02:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:f7:02:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_vif [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c8ad360-aa, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:33 user nova-compute[71507]: INFO os_vif [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa')
Apr 13 15:20:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:20:33 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f933ab9-f8a8-403d-904c-d07a4267b11d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:20:33 user nova-compute[71507]: No targets found.
Apr 13 15:20:33 user nova-compute[71507]: iSNS:
Apr 13 15:20:33 user nova-compute[71507]: No targets found.
Apr 13 15:20:33 user nova-compute[71507]: STATIC:
Apr 13 15:20:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566
Apr 13 15:20:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027
Apr 13 15:20:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:20:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c
Apr 13 15:20:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17
Apr 13 15:20:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f
Apr 13 15:20:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:33 user nova-compute[71507]: FIRMWARE:
Apr 13 15:20:33 user nova-compute[71507]: No targets found.
Apr 13 15:20:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:20:33 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:20:33 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0ab724-d5e2-4638-a3ab-9d11fdadd8cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c1710e-073c-401c-92b6-760e8eb172a6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:33 user nova-compute[71507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1422e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f'): ({'sdg'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Removing single pathed devices sdg {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ea86f8-9164-497a-9aaa-3c49e3e4ec51]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[da38e49a-c9f8-4dd1-a7d9-f5973462283c]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flushing IO for device /dev/sdg {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dfb623-c443-4658-84a8-e3f33d783403]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d039acc-6357-4f8f-aff4-a77e7b472900]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] SCSI volumes sdg have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9414978-ea81-485c-bf0d-7e45148fcfd9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f143a0c2-4791-4090-8dd0-cc50f3d79edb]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]
Apr 13 15:20:33 user nova-compute[71507]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.
Apr 13 15:20:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.073s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9217c64-16c6-4e6f-95a7-b7a5bd3a764f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== disconnect_volume: return (363ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:20:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75_resize/disk /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "cp -r /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75_resize/disk /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk" returned: 0 in 0.341s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75_resize/disk.info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk.info {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "cp -r /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75_resize/disk.info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk.info" returned: 0 in 0.031s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:20:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:20:34 user nova-compute[71507]: WARNING nova.compute.manager [req-dd2e8501-0edc-452d-bd99-b7dac881ca42 req-025f27ef-7e0f-4d9f-82b2-0f83acbff850 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state active and task_state resize_migrating.
Apr 13 15:20:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Port 9c8ad360-aa62-4ef1-952f-d73f885baa89 binding to destination host user is already ACTIVE {{(pid=71507) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 15:20:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:20:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:20:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance_info_cache with network_info: [{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG os_brick.utils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc59489-01c9-4aa2-a209-e90cff79cf03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a32594-acb3-40b3-bd7c-af62cc2d4f98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fafe405-4cbb-4f03-b625-89de72605f36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[945795bc-0c21-41a3-84ea-727cb3528284]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:20:36 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:20:36 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeb5f94-44e9-4562-8e52-982b924cc160]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:20:36 user nova-compute[71507]: DEBUG os_brick.utils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:20:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Starting finish_migration {{(pid=71507) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance directory exists: not creating {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 15:20:40 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Creating image(s)
Apr 13 15:20:40 user nova-compute[71507]: DEBUG nova.objects.instance [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'trusted_certs' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Cannot resize image /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Ensure instance console log exists: /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Start _get_guest_xml network_info=[{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:f7:02:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75', 'attached_at': '2023-04-13T15:20:41.000000', 'detached_at': '', 'volume_id': '23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'serial': '23e2b917-2efe-4a44-8c06-1a70d0c6d09f'}, 'attachment_id': 'fbea1988-23cf-4385-b694-f42839c12a94', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:20:41 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:20:41 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.objects.instance [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'vcpu_model' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:20:41 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:20:41 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:20:41 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad4c9c3-fcbc-4b48-a436-0896fdcf8737]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:20:41 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2407ddee-d35d-4776-a902-5936decce08f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f] added
Apr 13 15:20:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed6472c-4070-456c-90d6-148dcd62f272]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.132s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f16d944-c3cf-44b6-8650-4497c919234b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXpRLefv {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXpRLefv" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[275a56c2-acb4-4508-a74c-113a6c9b2300]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXpRLefv'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fc28fd-f710-407d-bc47-8d02bef96431]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76621b-efda-457c-83b7-f8fecf36f68b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5112d043-a996-4be9-acd1-1e7249587755]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]
Apr 13 15:20:41 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.
Apr 13 15:20:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e0a41b-417b-4300-811a-b56cf8f4c3c1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8dfcbf-960b-4561-a1bd-07e1f35cab97]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:41 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:41 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[251d2e85-a292-4524-8647-a439e4beda77]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:41 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23862346631373431', 'path': '/dev/sdg'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862346631373431', 'path': '/dev/sdg'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:f7:02:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:f7:02:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:20:42 user nova-compute[71507]:   <uuid>ccc7b5bd-5f78-448e-bd82-74b2263dff75</uuid>
Apr 13 15:20:42 user nova-compute[71507]:   <name>instance-00000011</name>
Apr 13 15:20:42 user nova-compute[71507]:   <memory>196608</memory>
Apr 13 15:20:42 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:20:42 user nova-compute[71507]:   <metadata>
Apr 13 15:20:42 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:20:42 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:20:42 user nova-compute[71507]:       <nova:name>tempest-ServerActionsTestJSON-server-2112327637</nova:name>
Apr 13 15:20:42 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:20:41</nova:creationTime>
Apr 13 15:20:42 user nova-compute[71507]:       <nova:flavor name="m1.micro">
Apr 13 15:20:42 user nova-compute[71507]:         <nova:memory>192</nova:memory>
Apr 13 15:20:42 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:20:42 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:20:42 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:20:42 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:20:42 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:20:42 user nova-compute[71507]:       <nova:owner>
Apr 13 15:20:42 user nova-compute[71507]:         <nova:user uuid="3c12c62d4137473596571e523163e718">tempest-ServerActionsTestJSON-423674903-project-member</nova:user>
Apr 13 15:20:42 user nova-compute[71507]:         <nova:project uuid="9154e4239a1a42a3820c27563ba0513f">tempest-ServerActionsTestJSON-423674903</nova:project>
Apr 13 15:20:42 user nova-compute[71507]:       </nova:owner>
Apr 13 15:20:42 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:20:42 user nova-compute[71507]:       <nova:ports>
Apr 13 15:20:42 user nova-compute[71507]:         <nova:port uuid="9c8ad360-aa62-4ef1-952f-d73f885baa89">
Apr 13 15:20:42 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 15:20:42 user nova-compute[71507]:         </nova:port>
Apr 13 15:20:42 user nova-compute[71507]:       </nova:ports>
Apr 13 15:20:42 user nova-compute[71507]:     </nova:instance>
Apr 13 15:20:42 user nova-compute[71507]:   </metadata>
Apr 13 15:20:42 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:20:42 user nova-compute[71507]:     <system>
Apr 13 15:20:42 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:20:42 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:20:42 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:20:42 user nova-compute[71507]:       <entry name="serial">ccc7b5bd-5f78-448e-bd82-74b2263dff75</entry>
Apr 13 15:20:42 user nova-compute[71507]:       <entry name="uuid">ccc7b5bd-5f78-448e-bd82-74b2263dff75</entry>
Apr 13 15:20:42 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:20:42 user nova-compute[71507]:     </system>
Apr 13 15:20:42 user nova-compute[71507]:   </sysinfo>
Apr 13 15:20:42 user nova-compute[71507]:   <os>
Apr 13 15:20:42 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:20:42 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:20:42 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:20:42 user nova-compute[71507]:   </os>
Apr 13 15:20:42 user nova-compute[71507]:   <features>
Apr 13 15:20:42 user nova-compute[71507]:     <acpi/>
Apr 13 15:20:42 user nova-compute[71507]:     <apic/>
Apr 13 15:20:42 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:20:42 user nova-compute[71507]:   </features>
Apr 13 15:20:42 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:20:42 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:20:42 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:20:42 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:20:42 user nova-compute[71507]:   </clock>
Apr 13 15:20:42 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:20:42 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:20:42 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:20:42 user nova-compute[71507]:   </cpu>
Apr 13 15:20:42 user nova-compute[71507]:   <devices>
Apr 13 15:20:42 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:20:42 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:20:42 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk"/>
Apr 13 15:20:42 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:20:42 user nova-compute[71507]:     </disk>
Apr 13 15:20:42 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:20:42 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:20:42 user nova-compute[71507]:       <source dev="/dev/sdg"/>
Apr 13 15:20:42 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:20:42 user nova-compute[71507]:       <serial>23e2b917-2efe-4a44-8c06-1a70d0c6d09f</serial>
Apr 13 15:20:42 user nova-compute[71507]:     </disk>
Apr 13 15:20:42 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:20:42 user nova-compute[71507]:       <mac address="fa:16:3e:f7:02:ec"/>
Apr 13 15:20:42 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:20:42 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:20:42 user nova-compute[71507]:       <target dev="tap9c8ad360-aa"/>
Apr 13 15:20:42 user nova-compute[71507]:     </interface>
Apr 13 15:20:42 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:20:42 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/console.log" append="off"/>
Apr 13 15:20:42 user nova-compute[71507]:     </serial>
Apr 13 15:20:42 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:20:42 user nova-compute[71507]:     <video>
Apr 13 15:20:42 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:20:42 user nova-compute[71507]:     </video>
Apr 13 15:20:42 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:20:42 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:20:42 user nova-compute[71507]:     </rng>
Apr 13 15:20:42 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:20:42 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:20:42 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:20:42 user nova-compute[71507]:     </memballoon>
Apr 13 15:20:42 user nova-compute[71507]:   </devices>
Apr 13 15:20:42 user nova-compute[71507]: </domain>
Apr 13 15:20:42 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:f7:02:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:f7:02:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG os_vif [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c8ad360-aa, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c8ad360-aa, col_values=(('external_ids', {'iface-id': '9c8ad360-aa62-4ef1-952f-d73f885baa89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:02:ec', 'vm-uuid': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:42 user nova-compute[71507]: INFO os_vif [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa')
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:20:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No VIF found with MAC fa:16:3e:f7:02:ec, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:20:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:20:44 user nova-compute[71507]: WARNING nova.compute.manager [req-7ad635b8-8413-47f5-b1a7-b7e85a42ff4f req-60755a52-3d38-4078-ba6e-b0e34af96b71 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state active and task_state resize_finish.
Apr 13 15:20:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for ccc7b5bd-5f78-448e-bd82-74b2263dff75 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399246.0801556, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:20:46 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] VM Resumed (Lifecycle Event)
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:20:46 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance running successfully.
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Failed to set time: agent not configured {{(pid=71507) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3d6a9303-9ef2-4d04-8b8d-55b93099e0b0 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] finish_migration finished successfully. {{(pid=71507) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:20:46 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399246.0814316, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:20:46 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] VM Started (Lifecycle Event)
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:20:46 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:20:46 user nova-compute[71507]: WARNING nova.compute.manager [req-fadb6336-5c9a-45c9-b296-c42a58242064 req-6efb8033-9584-4cd0-817c-15cf8183deb9 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state active and task_state resize_finish.
Apr 13 15:20:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:48 user nova-compute[71507]: INFO nova.compute.manager [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Detaching volume 73467274-8e1f-4536-9458-f3e619202566
Apr 13 15:20:48 user nova-compute[71507]: INFO nova.virt.block_device [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Attempting to driver detach volume 73467274-8e1f-4536-9458-f3e619202566 from mountpoint /dev/vdb
Apr 13 15:20:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Attempting to detach device vdb from instance 3dc146f3-9150-4920-b468-9aebcbc81162 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:20:48 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:20:48 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:20:48 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:20:48 user nova-compute[71507]:   <serial>73467274-8e1f-4536-9458-f3e619202566</serial>
Apr 13 15:20:48 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:20:48 user nova-compute[71507]: </disk>
Apr 13 15:20:48 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:20:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully detached device vdb from instance 3dc146f3-9150-4920-b468-9aebcbc81162 from the persistent domain config.
Apr 13 15:20:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3dc146f3-9150-4920-b468-9aebcbc81162 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:20:48 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:20:48 user nova-compute[71507]:   <source dev="/dev/sdf"/>
Apr 13 15:20:48 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:20:48 user nova-compute[71507]:   <serial>73467274-8e1f-4536-9458-f3e619202566</serial>
Apr 13 15:20:48 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:20:48 user nova-compute[71507]: </disk>
Apr 13 15:20:48 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399248.6096613, 3dc146f3-9150-4920-b468-9aebcbc81162 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3dc146f3-9150-4920-b468-9aebcbc81162 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:20:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully detached device vdb from instance 3dc146f3-9150-4920-b468-9aebcbc81162 from the live domain config.
Apr 13 15:20:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lIEQTyxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:20:48 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9edd13-a831-41ce-8261-dd4557425522]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:20:48 user nova-compute[71507]: No targets found.
Apr 13 15:20:48 user nova-compute[71507]: iSNS:
Apr 13 15:20:48 user nova-compute[71507]: No targets found.
Apr 13 15:20:48 user nova-compute[71507]: STATIC:
Apr 13 15:20:48 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566
Apr 13 15:20:48 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:48 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:48 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027
Apr 13 15:20:48 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:48 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:48 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:20:48 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:48 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:48 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c
Apr 13 15:20:48 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:48 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:48 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17
Apr 13 15:20:48 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:48 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:48 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f
Apr 13 15:20:48 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:48 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:48 user nova-compute[71507]: FIRMWARE:
Apr 13 15:20:48 user nova-compute[71507]: No targets found.
Apr 13 15:20:48 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:20:48 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:20:48 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e9db72-6bb5-4c8e-9e2c-bf101186f56a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7af3f7-7cee-4f24-8aa0-dc0a9f6adf15]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:48 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:48 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:48 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1422dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566'): ({'sdf'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Removing single pathed devices sdf {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e47214-5828-45ec-a224-296e9d55916a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a43161-45eb-4c29-b331-81c2c4a1a081]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flushing IO for device /dev/sdf {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b98744e-2007-41cd-8d0a-b78ed46b7085]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2bd169-2ebf-4239-bdaf-de30a34b4d0a]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] SCSI volumes sdf have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a6872-d527-482a-be0f-1a0973416cfe]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[20edf4f5-2e24-4ddc-8295-2f5caa24fbca]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566, portal: 172.16.0.220,3260]
Apr 13 15:20:48 user nova-compute[71507]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566, portal: 172.16.0.220,3260] successful.
Apr 13 15:20:48 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73467274-8e1f-4536-9458-f3e619202566 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c9ed69-dfc3-4f23-9fda-a6bda164bd4a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] <== disconnect_volume: return (347ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:20:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:20:49 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'flavor' on Instance uuid 3dc146f3-9150-4920-b468-9aebcbc81162 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7014c149-5a05-4d4f-8087-50bd761d1a0c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.767s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing instance network info cache due to event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:20:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] Acquiring lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:20:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] Acquired lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:20:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:20:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updated VIF entry in instance network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:20:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updating instance_info_cache with network_info: [{"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:20:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-994cc429-4bde-4cd5-8d6d-b2251d4a4a78 req-04b038d8-445d-4200-9a97-281d3531b7ad service nova] Releasing lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:20:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing instance network info cache due to event network-changed-df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:20:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] Acquiring lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:20:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] Acquired lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:20:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Refreshing network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:55 user nova-compute[71507]: INFO nova.compute.manager [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Detaching volume 11a7881b-efa3-43da-9fd0-3e26df187b17
Apr 13 15:20:55 user nova-compute[71507]: INFO nova.virt.block_device [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Attempting to driver detach volume 11a7881b-efa3-43da-9fd0-3e26df187b17 from mountpoint /dev/vdb
Apr 13 15:20:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Attempting to detach device vdb from instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:20:55 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:20:55 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:20:55 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:20:55 user nova-compute[71507]:   <serial>11a7881b-efa3-43da-9fd0-3e26df187b17</serial>
Apr 13 15:20:55 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:20:55 user nova-compute[71507]: </disk>
Apr 13 15:20:55 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:20:55 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully detached device vdb from instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe from the persistent domain config.
Apr 13 15:20:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:20:55 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:20:55 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:20:55 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:20:55 user nova-compute[71507]:   <serial>11a7881b-efa3-43da-9fd0-3e26df187b17</serial>
Apr 13 15:20:55 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:20:55 user nova-compute[71507]: </disk>
Apr 13 15:20:55 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG nova.network.neutron [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updated VIF entry in instance network info cache for port df99421e-bdc6-4fe5-9865-823bcb128ccc. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG nova.network.neutron [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updating instance_info_cache with network_info: [{"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9b423931-0522-42ef-b101-5ef88e04a9eb req-cbba8210-d89a-43d3-82c6-b3f9731234f3 service nova] Releasing lock "refresh_cache-e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399255.7220862, e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:20:55 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully detached device vdb from instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe from the live domain config.
Apr 13 15:20:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zowCdWuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:20:55 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[de712436-d1bd-4b0c-ab13-9bc4d247e4ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:20:55 user nova-compute[71507]: No targets found.
Apr 13 15:20:55 user nova-compute[71507]: iSNS:
Apr 13 15:20:55 user nova-compute[71507]: No targets found.
Apr 13 15:20:55 user nova-compute[71507]: STATIC:
Apr 13 15:20:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027
Apr 13 15:20:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:20:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c
Apr 13 15:20:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17
Apr 13 15:20:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:55 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f
Apr 13 15:20:55 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:20:55 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:20:55 user nova-compute[71507]: FIRMWARE:
Apr 13 15:20:55 user nova-compute[71507]: No targets found.
Apr 13 15:20:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:20:55 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:20:55 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea005ff-4a4d-4629-bb82-cac0aa7a71d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6934c2c-7517-4cdf-8330-05ddac166f01]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:55 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:55 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:55 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:55 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:55 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:55 user nova-compute[71507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 (non-flash)
Apr 13 15:20:55 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:55 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c279510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c95c8ca-96d4-4109-8a6e-4ef587775a82]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fa9807-5a29-4b19-8e0a-f7ef4d66e7e2]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[112171f6-edec-4590-9264-cf7072247557]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc26e09e-2736-46e0-9fa0-ce7019d0d3a9]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dd9f73-aeb4-4050-ab4f-e395cdd4547d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1886cc-3c23-438e-9999-1b61454ee9f8]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17, portal: 172.16.0.220,3260]
Apr 13 15:20:56 user nova-compute[71507]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17, portal: 172.16.0.220,3260] successful.
Apr 13 15:20:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a7881b-efa3-43da-9fd0-3e26df187b17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ed275e-bb68-414b-8042-42ef461ca1c1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] <== disconnect_volume: return (322ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:20:56 user nova-compute[71507]: INFO nova.compute.manager [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Rescuing
Apr 13 15:20:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquired lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG nova.network.neutron [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG nova.network.neutron [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Updating instance_info_cache with network_info: [{"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Releasing lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'flavor' on Instance uuid e1c4cb29-65fa-4b48-b7a2-cac613cb96fe {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7ef072d6-939e-417d-81c0-4e30fe10fc96 tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.832s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-unplugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-unplugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:20:57 user nova-compute[71507]: WARNING nova.compute.manager [req-e735f07f-d68c-4030-be95-91ee4884c73f req-913f2ab1-de50-4efa-a3d0-0f39a1059248 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-unplugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state active and task_state rescuing.
Apr 13 15:20:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Instance destroyed successfully.
Apr 13 15:20:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Attempting a stable device rescue
Apr 13 15:20:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Instance directory exists: not creating {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 15:20:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Creating image(s)
Apr 13 15:20:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "/opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "/opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "/opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG nova.objects.instance [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'trusted_certs' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "5a2552e2f319d1cf866c4780264c56b3886dee11" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "5a2552e2f319d1cf866c4780264c56b3886dee11" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11.part --force-share --output=json" returned: 0 in 0.156s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG nova.virt.images [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] 1b8e7776-9945-4e57-b8ce-e785793cb330 was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11.part /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11.part /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11.converted" returned: 0 in 0.262s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11.converted --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "5a2552e2f319d1cf866c4780264c56b3886dee11" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.289s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "5a2552e2f319d1cf866c4780264c56b3886dee11" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "5a2552e2f319d1cf866c4780264c56b3886dee11" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11 --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11,backing_fmt=raw /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11,backing_fmt=raw /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue" returned: 0 in 0.062s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "5a2552e2f319d1cf866c4780264c56b3886dee11" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.objects.instance [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'migration_context' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Start _get_guest_xml network_info=[{"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "vif_mac": "fa:16:3e:e2:51:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1b8e7776-9945-4e57-b8ce-e785793cb330', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnmljsyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'c609c1d1-edcf-4b71-abea-5dd95ebcd81f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2a3847f-ce95-4277-be5b-0a4becc7711c', 'serial': 'c2a3847f-ce95-4277-be5b-0a4becc7711c'}, 'attachment_id': 'dbb2661e-b94f-4754-96f9-5ef5018ed155', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.objects.instance [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'resources' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.objects.instance [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'numa_topology' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.compute.manager [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.compute.manager [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:20:59 user nova-compute[71507]: WARNING nova.compute.manager [req-60d33d88-9f9a-4ac9-9773-f18a73f4095c req-f5a2403b-58a7-4cd2-84c1-b93cb83cc366 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state active and task_state rescuing.
Apr 13 15:20:59 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:20:59 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.objects.instance [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'vcpu_model' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnmljsyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:20:59 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:20:59 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:20:59 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[618e3f98-6b1a-468a-b87c-0d05d8bf18b2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GnmljsyO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 15:20:59 user nova-compute[71507]: node.name = iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c
Apr 13 15:20:59 user nova-compute[71507]: node.tpgt = -1
Apr 13 15:20:59 user nova-compute[71507]: node.startup = automatic
Apr 13 15:20:59 user nova-compute[71507]: node.leading_login = No
Apr 13 15:20:59 user nova-compute[71507]: iface.iscsi_ifacename = default
Apr 13 15:20:59 user nova-compute[71507]: iface.net_ifacename = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.ipaddress = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.prefix_len = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.hwaddress = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.transport_name = tcp
Apr 13 15:20:59 user nova-compute[71507]: iface.initiatorname = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.state = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.vlan_id = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.vlan_priority = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.vlan_state = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.iface_num = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.mtu = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.port = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.bootproto = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.subnet_mask = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.gateway = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.dhcp_alt_client_id = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.dhcp_dns = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.dhcp_learn_iqn = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.dhcp_vendor_id_state = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.dhcp_vendor_id = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.dhcp_slp_da = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.fragmentation = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.gratuitous_arp = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.incoming_forwarding = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.tos_state = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.tos = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.ttl = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.delayed_ack = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.tcp_nagle = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.tcp_wsf_state = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.tcp_wsf = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.tcp_timer_scale = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.tcp_timestamp = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.redirect = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.def_task_mgmt_timeout = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.header_digest = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.data_digest = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.immediate_data = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.initial_r2t = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.data_seq_inorder = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.data_pdu_inorder = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.erl = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.max_receive_data_len = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.first_burst_len = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.max_outstanding_r2t = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.max_burst_len = 0
Apr 13 15:20:59 user nova-compute[71507]: iface.chap_auth = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.bidi_chap = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.strict_login_compliance = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.discovery_auth = <empty>
Apr 13 15:20:59 user nova-compute[71507]: iface.discovery_logout = <empty>
Apr 13 15:20:59 user nova-compute[71507]: node.discovery_address = <empty>
Apr 13 15:20:59 user nova-compute[71507]: node.discovery_port = 0
Apr 13 15:20:59 user nova-compute[71507]: node.discovery_type = static
Apr 13 15:20:59 user nova-compute[71507]: node.session.initial_cmdsn = 0
Apr 13 15:20:59 user nova-compute[71507]: node.session.initial_login_retry_max = 8
Apr 13 15:20:59 user nova-compute[71507]: node.session.xmit_thread_priority = -20
Apr 13 15:20:59 user nova-compute[71507]: node.session.cmds_max = 128
Apr 13 15:20:59 user nova-compute[71507]: node.session.queue_depth = 32
Apr 13 15:20:59 user nova-compute[71507]: node.session.nr_sessions = 1
Apr 13 15:20:59 user nova-compute[71507]: node.session.auth.authmethod = CHAP
Apr 13 15:20:59 user nova-compute[71507]: node.session.auth.username = GnmljsyO
Apr 13 15:20:59 user nova-compute[71507]: node.session.auth.password = ***
Apr 13 15:20:59 user nova-compute[71507]: node.session.auth.username_in = <empty>
Apr 13 15:20:59 user nova-compute[71507]: node.session.auth.password_in = <empty>
Apr 13 15:20:59 user nova-compute[71507]: node.session.auth.chap_algs = MD5
Apr 13 15:20:59 user nova-compute[71507]: node.session.timeo.replacement_timeout = 120
Apr 13 15:20:59 user nova-compute[71507]: node.session.err_timeo.abort_timeout = 15
Apr 13 15:20:59 user nova-compute[71507]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 15:20:59 user nova-compute[71507]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 15:20:59 user nova-compute[71507]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.FastAbort = Yes
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.InitialR2T = No
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.ImmediateData = Yes
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.MaxConnections = 1
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 15:20:59 user nova-compute[71507]: node.session.iscsi.ERL = 0
Apr 13 15:20:59 user nova-compute[71507]: node.session.scan = manual
Apr 13 15:20:59 user nova-compute[71507]: node.session.reopen_max = 0
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].address = 172.16.0.220
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].port = 3260
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].startup = manual
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].tcp.window_size = 524288
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].tcp.type_of_service = 0
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].timeo.logout_timeout = 15
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].timeo.login_timeout = 15
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].timeo.auth_timeout = 45
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].iscsi.DataDigest = None
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].iscsi.IFMarker = No
Apr 13 15:20:59 user nova-compute[71507]: node.conn[0].iscsi.OFMarker = No
Apr 13 15:20:59 user nova-compute[71507]: # END RECORD
Apr 13 15:20:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[472f088e-9a8a-44aa-94b9-de2b745085e6]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8256fa-6d9e-40b9-a54c-93ce11ecd042]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnmljsyO {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnmljsyO" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[198d58d0-8773-402d-bca7-4319b84de671]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GnmljsyO'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e56467-cde9-4efc-99e8-65d13c03abab]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7350776-3a34-4cef-ba84-f68eed502b6f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:59 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:59 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:59 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:20:59 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:20:59 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:20:59 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:20:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] HCTL ('35', '0', '0', 0) found on session 30 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[934251a2-0b30-4a23-ac17-589e26c613ec]: (4, ('0 0 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Searching for a device in session 30 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnmljsyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] <== connect_volume: return (167ms) {'type': 'block', 'scsi_wwn': '26564303632623336', 'path': '/dev/sdd'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564303632623336', 'path': '/dev/sdd'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82933329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82933329',id=26,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:19:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-mpki9sme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:19:22Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=c609c1d1-edcf-4b71-abea-5dd95ebcd81f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "vif_mac": "fa:16:3e:e2:51:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "vif_mac": "fa:16:3e:e2:51:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:51:fe,bridge_name='br-int',has_traffic_filtering=True,id=92d492eb-f3b6-4481-b492-949cf7eabd1a,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d492eb-f3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.objects.instance [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'pci_devices' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:20:59 user nova-compute[71507]:   <uuid>c609c1d1-edcf-4b71-abea-5dd95ebcd81f</uuid>
Apr 13 15:20:59 user nova-compute[71507]:   <name>instance-0000001a</name>
Apr 13 15:20:59 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:20:59 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:20:59 user nova-compute[71507]:   <metadata>
Apr 13 15:20:59 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:20:59 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:20:59 user nova-compute[71507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-82933329</nova:name>
Apr 13 15:20:59 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:20:59</nova:creationTime>
Apr 13 15:20:59 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:20:59 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:20:59 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:20:59 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:20:59 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:20:59 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:20:59 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:20:59 user nova-compute[71507]:       <nova:owner>
Apr 13 15:20:59 user nova-compute[71507]:         <nova:user uuid="75bf6e19993f4c2e90fd52c4d6212622">tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member</nova:user>
Apr 13 15:20:59 user nova-compute[71507]:         <nova:project uuid="240b28f42732478ba732994b2c9e3fbe">tempest-ServerBootFromVolumeStableRescueTest-1009244781</nova:project>
Apr 13 15:20:59 user nova-compute[71507]:       </nova:owner>
Apr 13 15:20:59 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:20:59 user nova-compute[71507]:       <nova:ports>
Apr 13 15:20:59 user nova-compute[71507]:         <nova:port uuid="92d492eb-f3b6-4481-b492-949cf7eabd1a">
Apr 13 15:20:59 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 15:20:59 user nova-compute[71507]:         </nova:port>
Apr 13 15:20:59 user nova-compute[71507]:       </nova:ports>
Apr 13 15:20:59 user nova-compute[71507]:     </nova:instance>
Apr 13 15:20:59 user nova-compute[71507]:   </metadata>
Apr 13 15:20:59 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:20:59 user nova-compute[71507]:     <system>
Apr 13 15:20:59 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:20:59 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:20:59 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:20:59 user nova-compute[71507]:       <entry name="serial">c609c1d1-edcf-4b71-abea-5dd95ebcd81f</entry>
Apr 13 15:20:59 user nova-compute[71507]:       <entry name="uuid">c609c1d1-edcf-4b71-abea-5dd95ebcd81f</entry>
Apr 13 15:20:59 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:20:59 user nova-compute[71507]:     </system>
Apr 13 15:20:59 user nova-compute[71507]:   </sysinfo>
Apr 13 15:20:59 user nova-compute[71507]:   <os>
Apr 13 15:20:59 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:20:59 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:20:59 user nova-compute[71507]:   </os>
Apr 13 15:20:59 user nova-compute[71507]:   <features>
Apr 13 15:20:59 user nova-compute[71507]:     <acpi/>
Apr 13 15:20:59 user nova-compute[71507]:     <apic/>
Apr 13 15:20:59 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:20:59 user nova-compute[71507]:   </features>
Apr 13 15:20:59 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:20:59 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:20:59 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:20:59 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:20:59 user nova-compute[71507]:   </clock>
Apr 13 15:20:59 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:20:59 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:20:59 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:20:59 user nova-compute[71507]:   </cpu>
Apr 13 15:20:59 user nova-compute[71507]:   <devices>
Apr 13 15:20:59 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:20:59 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:20:59 user nova-compute[71507]:       <source dev="/dev/sdd"/>
Apr 13 15:20:59 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:20:59 user nova-compute[71507]:       <serial>c2a3847f-ce95-4277-be5b-0a4becc7711c</serial>
Apr 13 15:20:59 user nova-compute[71507]:     </disk>
Apr 13 15:20:59 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:20:59 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:20:59 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue"/>
Apr 13 15:20:59 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:20:59 user nova-compute[71507]:       <boot order="1"/>
Apr 13 15:20:59 user nova-compute[71507]:     </disk>
Apr 13 15:20:59 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:20:59 user nova-compute[71507]:       <mac address="fa:16:3e:e2:51:fe"/>
Apr 13 15:20:59 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:20:59 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:20:59 user nova-compute[71507]:       <target dev="tap92d492eb-f3"/>
Apr 13 15:20:59 user nova-compute[71507]:     </interface>
Apr 13 15:20:59 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:20:59 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/console.log" append="off"/>
Apr 13 15:20:59 user nova-compute[71507]:     </serial>
Apr 13 15:20:59 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:20:59 user nova-compute[71507]:     <video>
Apr 13 15:20:59 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:20:59 user nova-compute[71507]:     </video>
Apr 13 15:20:59 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:20:59 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:20:59 user nova-compute[71507]:     </rng>
Apr 13 15:20:59 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:20:59 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:20:59 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:20:59 user nova-compute[71507]:     </memballoon>
Apr 13 15:20:59 user nova-compute[71507]:   </devices>
Apr 13 15:20:59 user nova-compute[71507]: </domain>
Apr 13 15:20:59 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:20:59 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Instance destroyed successfully.
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:20:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] No VIF found with MAC fa:16:3e:e2:51:fe, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:21:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:21:01 user nova-compute[71507]: WARNING nova.compute.manager [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state active and task_state rescuing.
Apr 13 15:21:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:21:01 user nova-compute[71507]: WARNING nova.compute.manager [req-399bdd3c-78e3-4ef6-8998-a5f340841832 req-72d3ed80-82e6-4277-a928-126eb5252275 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state active and task_state rescuing.
Apr 13 15:21:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for c609c1d1-edcf-4b71-abea-5dd95ebcd81f due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:21:02 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399262.9073086, c609c1d1-edcf-4b71-abea-5dd95ebcd81f => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:21:02 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] VM Resumed (Lifecycle Event)
Apr 13 15:21:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-0e6e8004-37dd-4a0e-bdd3-4e02153cf29f tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:21:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:21:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:21:02 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 15:21:02 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399262.9086432, c609c1d1-edcf-4b71-abea-5dd95ebcd81f => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:21:02 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] VM Started (Lifecycle Event)
Apr 13 15:21:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:21:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:21:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:19 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:21:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:21:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:21:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7733MB free_disk=25.946613311767578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Applying migration context for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 as it has an incoming, in-progress migration 99dd52ce-1c03-4b59-b1a2-872bc1613000. Migration status is finished {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 15:21:32 user nova-compute[71507]: INFO nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating resource usage from migration 99dd52ce-1c03-4b59-b1a2-872bc1613000
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 3dc146f3-9150-4920-b468-9aebcbc81162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Migration 99dd52ce-1c03-4b59-b1a2-872bc1613000 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:21:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:21:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:33 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:21:33 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:21:33 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:21:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:36 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:36 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:21:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:38 user nova-compute[71507]: INFO nova.compute.manager [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Terminating instance
Apr 13 15:21:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received event network-vif-unplugged-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] No waiting events found dispatching network-vif-unplugged-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:21:38 user nova-compute[71507]: DEBUG nova.compute.manager [req-5309694f-bb42-4870-bfd3-9fc826f6672d req-404ca7e5-a887-4c1a-b007-4eceb879f558 service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received event network-vif-unplugged-8f16dd83-a089-414b-9525-cc7ef42c7331 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:21:39 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Instance destroyed successfully.
Apr 13 15:21:39 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'resources' on Instance uuid 3dc146f3-9150-4920-b468-9aebcbc81162 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1109825086',display_name='tempest-AttachVolumeNegativeTest-server-1109825086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1109825086',id=22,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJYk9tq5AvbxsFkvXz5FVdGRka7rNiMF6WvvCvJVSoNv884hYwfP0GXu7pHHmy35RfD0O62LDgQO/pA3hHgZ02L7AhEcCLbnl0u1GsjlLAH6Mo68d+qkyG5GIOBX6RHAA==',key_name='tempest-keypair-1984106079',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:16:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-3m8j98ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=3dc146f3-9150-4920-b468-9aebcbc81162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "8f16dd83-a089-414b-9525-cc7ef42c7331", "address": "fa:16:3e:fb:bb:a0", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16dd83-a0", "ovs_interfaceid": "8f16dd83-a089-414b-9525-cc7ef42c7331", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:bb:a0,bridge_name='br-int',has_traffic_filtering=True,id=8f16dd83-a089-414b-9525-cc7ef42c7331,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16dd83-a0') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG os_vif [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:bb:a0,bridge_name='br-int',has_traffic_filtering=True,id=8f16dd83-a089-414b-9525-cc7ef42c7331,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16dd83-a0') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f16dd83-a0, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:21:39 user nova-compute[71507]: INFO os_vif [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:bb:a0,bridge_name='br-int',has_traffic_filtering=True,id=8f16dd83-a089-414b-9525-cc7ef42c7331,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16dd83-a0')
Apr 13 15:21:39 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Deleting instance files /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162_del
Apr 13 15:21:39 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Deletion of /opt/stack/data/nova/instances/3dc146f3-9150-4920-b468-9aebcbc81162_del complete
Apr 13 15:21:39 user nova-compute[71507]: INFO nova.compute.manager [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 15:21:39 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:21:39 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:21:40 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Took 0.84 seconds to deallocate network for instance.
Apr 13 15:21:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received event network-vif-deleted-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:40 user nova-compute[71507]: INFO nova.compute.manager [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Neutron deleted interface 8f16dd83-a089-414b-9525-cc7ef42c7331; detaching it from the instance and deleting it from the info cache
Apr 13 15:21:40 user nova-compute[71507]: DEBUG nova.network.neutron [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-7f2627bb-22a2-4742-8019-5b1af38f4a5f req-c3b5e7ac-edf6-45d2-8092-f5315161102b service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Detach interface failed, port_id=8f16dd83-a089-414b-9525-cc7ef42c7331, reason: Instance 3dc146f3-9150-4920-b468-9aebcbc81162 could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:40 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Deleted allocations for instance 3dc146f3-9150-4920-b468-9aebcbc81162
Apr 13 15:21:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e7bce3ec-6e8d-49ca-9dd1-3b5f3d48f02f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "3dc146f3-9150-4920-b468-9aebcbc81162" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received event network-vif-plugged-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] Acquiring lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] Lock "3dc146f3-9150-4920-b468-9aebcbc81162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] No waiting events found dispatching network-vif-plugged-8f16dd83-a089-414b-9525-cc7ef42c7331 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:21:40 user nova-compute[71507]: WARNING nova.compute.manager [req-cb4d8242-ce13-439e-a7dd-aa2b3dd38913 req-7b28281d-2c70-49e2-b064-7e74950b91fb service nova] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Received unexpected event network-vif-plugged-8f16dd83-a089-414b-9525-cc7ef42c7331 for instance with vm_state deleted and task_state None.
Apr 13 15:21:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:42 user nova-compute[71507]: INFO nova.compute.manager [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Detaching volume e0953e89-df86-47d7-9d9d-a5e263476027
Apr 13 15:21:42 user nova-compute[71507]: INFO nova.virt.block_device [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Attempting to driver detach volume e0953e89-df86-47d7-9d9d-a5e263476027 from mountpoint /dev/vdb
Apr 13 15:21:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Attempting to detach device vdb from instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:21:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:21:42 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:21:42 user nova-compute[71507]:   <source dev="/dev/sde"/>
Apr 13 15:21:42 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:21:42 user nova-compute[71507]:   <serial>e0953e89-df86-47d7-9d9d-a5e263476027</serial>
Apr 13 15:21:42 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:21:42 user nova-compute[71507]: </disk>
Apr 13 15:21:42 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:21:42 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Successfully detached device vdb from instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e from the persistent domain config.
Apr 13 15:21:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:21:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:21:42 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:21:42 user nova-compute[71507]:   <source dev="/dev/sde"/>
Apr 13 15:21:42 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:21:42 user nova-compute[71507]:   <serial>e0953e89-df86-47d7-9d9d-a5e263476027</serial>
Apr 13 15:21:42 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:21:42 user nova-compute[71507]: </disk>
Apr 13 15:21:42 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:21:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-changed-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Refreshing instance network info cache due to event network-changed-6343df00-b9ef-49a6-be1e-69f12895910f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:21:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Acquiring lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:21:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Acquired lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:21:42 user nova-compute[71507]: DEBUG nova.network.neutron [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Refreshing network info cache for port 6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399303.309786, 8b883f51-b15c-42d7-b71a-e80c11e7d77e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:21:43 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Successfully detached device vdb from instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e from the live domain config.
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvzgfSDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:21:43 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aa7e13-84cb-4818-a8c5-05b92f5b5da6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:21:43 user nova-compute[71507]: No targets found.
Apr 13 15:21:43 user nova-compute[71507]: iSNS:
Apr 13 15:21:43 user nova-compute[71507]: No targets found.
Apr 13 15:21:43 user nova-compute[71507]: STATIC:
Apr 13 15:21:43 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027
Apr 13 15:21:43 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:21:43 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:21:43 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:21:43 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:21:43 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:21:43 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c
Apr 13 15:21:43 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:21:43 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:21:43 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f
Apr 13 15:21:43 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:21:43 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:21:43 user nova-compute[71507]: FIRMWARE:
Apr 13 15:21:43 user nova-compute[71507]: No targets found.
Apr 13 15:21:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:21:43 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:21:43 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c071932-08e0-43ac-a77a-c2e30ba60106]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ada0ae2-51e6-4240-a5e0-ba454018aecb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:21:43 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:21:43 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:21:43 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:21:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:21:43 user nova-compute[71507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 (non-flash)
Apr 13 15:21:43 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:21:43 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:21:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1d7a71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027'): ({'sde'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Removing single pathed devices sde {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a3243d-5733-4aec-8aee-f6382f596717]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[52653c1c-34c2-4b41-a0ca-ab30265023e7]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Flushing IO for device /dev/sde {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.network.neutron [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updated VIF entry in instance network info cache for port 6343df00-b9ef-49a6-be1e-69f12895910f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.network.neutron [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updating instance_info_cache with network_info: [{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Releasing lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.compute.manager [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-changed-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.compute.manager [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Refreshing instance network info cache due to event network-changed-6343df00-b9ef-49a6-be1e-69f12895910f. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Acquiring lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Acquired lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.network.neutron [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Refreshing network info cache for port 6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cfb773-9510-49ed-bec1-077ae50e6df2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fa5fab-f8ae-477a-9e58-b4458dccd304]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c1b9b-b1ca-4651-a367-4ade68ff4b7b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd3d81e-1f3d-41ec-918a-8ec1fbe7582a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027, portal: 172.16.0.220,3260]
Apr 13 15:21:43 user nova-compute[71507]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027, portal: 172.16.0.220,3260] successful.
Apr 13 15:21:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0953e89-df86-47d7-9d9d-a5e263476027 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b124d1ce-c405-4578-b3ea-53ef730ca847]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] <== disconnect_volume: return (316ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.network.neutron [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updated VIF entry in instance network info cache for port 6343df00-b9ef-49a6-be1e-69f12895910f. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG nova.network.neutron [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updating instance_info_cache with network_info: [{"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:21:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-665cb86b-cb5c-48e0-8622-45b437242008 req-b843d6a3-0a3a-43cd-a9b4-3f98f0dcd6ba service nova] Releasing lock "refresh_cache-8b883f51-b15c-42d7-b71a-e80c11e7d77e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:21:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:44 user nova-compute[71507]: DEBUG nova.objects.instance [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'flavor' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:21:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-679b7e04-8cc2-4a94-8d07-4276a1bd5d45 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.882s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:47 user nova-compute[71507]: INFO nova.compute.manager [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Terminating instance
Apr 13 15:21:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:21:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-unplugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] No waiting events found dispatching network-vif-unplugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-ec417077-9d3b-4118-a7b6-6f5cfdf9fd18 req-facfc3e9-53c6-460c-8174-e6a59166ffa6 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-unplugged-df99421e-bdc6-4fe5-9865-823bcb128ccc for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Instance destroyed successfully.
Apr 13 15:21:48 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lazy-loading 'resources' on Instance uuid e1c4cb29-65fa-4b48-b7a2-cac613cb96fe {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-460869719',display_name='tempest-TestMinimumBasicScenario-server-460869719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-460869719',id=24,image_ref='a611381e-716d-4625-bba9-2ca0eb316ad3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDICxl86jLmymXogxNUJnQZrjPr/+8MrnAGTcu90n9UjsNhs+u6Mh3/NJl7vyFtf7K8I7ur6kH+VunKTEjTglWZT45qzOhWEU+r6IQk98Mkud+AgqZr5Ga1+FcK2IHkJEA==',key_name='tempest-TestMinimumBasicScenario-1152073766',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='738150b0ec0c4ce887397f161c7e8c21',ramdisk_id='',reservation_id='r-3n09o9t8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a611381e-716d-4625-bba9-2ca0eb316ad3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1239780022',owner_user_name='tempest-TestMinimumBasicScenario-1239780022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:19:10Z,user_data=None,user_id='c2322f71af2a478291bfb9d34046394c',uuid=e1c4cb29-65fa-4b48-b7a2-cac613cb96fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converting VIF {"id": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "address": "fa:16:3e:a5:0d:f6", "network": {"id": "31820944-67f5-43ce-b68d-522060649204", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-56093035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "738150b0ec0c4ce887397f161c7e8c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf99421e-bd", "ovs_interfaceid": "df99421e-bdc6-4fe5-9865-823bcb128ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=df99421e-bdc6-4fe5-9865-823bcb128ccc,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf99421e-bd') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG os_vif [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=df99421e-bdc6-4fe5-9865-823bcb128ccc,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf99421e-bd') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf99421e-bd, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:21:48 user nova-compute[71507]: INFO os_vif [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=df99421e-bdc6-4fe5-9865-823bcb128ccc,network=Network(31820944-67f5-43ce-b68d-522060649204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf99421e-bd')
Apr 13 15:21:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Deleting instance files /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe_del
Apr 13 15:21:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Deletion of /opt/stack/data/nova/instances/e1c4cb29-65fa-4b48-b7a2-cac613cb96fe_del complete
Apr 13 15:21:48 user nova-compute[71507]: INFO nova.compute.manager [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 15:21:48 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:21:48 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:21:49 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:21:49 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Took 0.53 seconds to deallocate network for instance.
Apr 13 15:21:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:49 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:21:49 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:21:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:49 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Deleted allocations for instance e1c4cb29-65fa-4b48-b7a2-cac613cb96fe
Apr 13 15:21:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ad5ce164-328f-4f04-ae34-231a7d878fbe tempest-TestMinimumBasicScenario-1239780022 tempest-TestMinimumBasicScenario-1239780022-project-member] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] Acquiring lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:21:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:21:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] Lock "e1c4cb29-65fa-4b48-b7a2-cac613cb96fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:21:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] No waiting events found dispatching network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:21:50 user nova-compute[71507]: WARNING nova.compute.manager [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received unexpected event network-vif-plugged-df99421e-bdc6-4fe5-9865-823bcb128ccc for instance with vm_state deleted and task_state None.
Apr 13 15:21:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-d6d045b9-c132-4481-a23d-e612682280c6 req-fcc5702d-ade8-4bc8-bdf1-a02a0f8bc4b7 service nova] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Received event network-vif-deleted-df99421e-bdc6-4fe5-9865-823bcb128ccc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:21:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:21:54 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399299.2261739, 3dc146f3-9150-4920-b468-9aebcbc81162 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:21:54 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] VM Stopped (Lifecycle Event)
Apr 13 15:21:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b2c18726-2c24-40fb-8af3-ee35eed954c7 None None] [instance: 3dc146f3-9150-4920-b468-9aebcbc81162] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:21:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:22:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:03 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399308.6272492, e1c4cb29-65fa-4b48-b7a2-cac613cb96fe => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:22:03 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] VM Stopped (Lifecycle Event)
Apr 13 15:22:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-82d8e312-4317-481d-8737-9e74ac069536 None None] [instance: e1c4cb29-65fa-4b48-b7a2-cac613cb96fe] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:11 user nova-compute[71507]: INFO nova.compute.manager [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Terminating instance
Apr 13 15:22:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-unplugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-unplugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-a6327054-62b7-478b-95c0-fe5d7f5c0813 req-fb0af8ae-4cdc-4d6e-9cdd-bea172702bbe service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-unplugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:22:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Instance destroyed successfully.
Apr 13 15:22:12 user nova-compute[71507]: DEBUG nova.objects.instance [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'resources' on Instance uuid 1aa74d14-db6f-41f5-b8af-32da312209d3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1504684221',display_name='tempest-AttachVolumeTestJSON-server-1504684221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1504684221',id=18,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2SLcMiFgeCGm8qDvk239BUNYX+UtVog7KDE/ZD3+2Ret07WDLkvqlCUEuqEVQhO7R4vu2xqjummEPXt2P2UbONLsP1RXtpmEWZvzafPSVJn4Tv2i6p0heMGqPGdn6X6w==',key_name='tempest-keypair-668401822',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-0f5qbue4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=1aa74d14-db6f-41f5-b8af-32da312209d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "84611f06-d6ca-49e1-afe7-7723921e62dc", "address": "fa:16:3e:a3:4a:01", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84611f06-d6", "ovs_interfaceid": "84611f06-d6ca-49e1-afe7-7723921e62dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG os_vif [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84611f06-d6, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:22:12 user nova-compute[71507]: INFO os_vif [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:4a:01,bridge_name='br-int',has_traffic_filtering=True,id=84611f06-d6ca-49e1-afe7-7723921e62dc,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84611f06-d6')
Apr 13 15:22:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Deleting instance files /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3_del
Apr 13 15:22:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Deletion of /opt/stack/data/nova/instances/1aa74d14-db6f-41f5-b8af-32da312209d3_del complete
Apr 13 15:22:12 user nova-compute[71507]: INFO nova.compute.manager [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 15:22:12 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:22:12 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:22:13 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Took 1.06 seconds to deallocate network for instance.
Apr 13 15:22:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-deleted-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:13 user nova-compute[71507]: INFO nova.compute.manager [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Neutron deleted interface 84611f06-d6ca-49e1-afe7-7723921e62dc; detaching it from the instance and deleting it from the info cache
Apr 13 15:22:13 user nova-compute[71507]: DEBUG nova.network.neutron [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-a2ed172b-d574-46eb-9aef-34e1577d403d req-e09bc171-cef5-493f-a7eb-7d1f29d83ce1 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Detach interface failed, port_id=84611f06-d6ca-49e1-afe7-7723921e62dc, reason: Instance 1aa74d14-db6f-41f5-b8af-32da312209d3 could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:13 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Deleted allocations for instance 1aa74d14-db6f-41f5-b8af-32da312209d3
Apr 13 15:22:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] Acquiring lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] No waiting events found dispatching network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:13 user nova-compute[71507]: WARNING nova.compute.manager [req-c4878b2f-2b9e-435c-8417-0da50cb2d626 req-b6c08d35-98d3-41d8-98dc-36d8549c6565 service nova] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Received unexpected event network-vif-plugged-84611f06-d6ca-49e1-afe7-7723921e62dc for instance with vm_state deleted and task_state None.
Apr 13 15:22:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-252c8c42-947a-4868-850e-d43fc3a31563 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "1aa74d14-db6f-41f5-b8af-32da312209d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.375s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Port 9c8ad360-aa62-4ef1-952f-d73f885baa89 binding to destination host user is already ACTIVE {{(pid=71507) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance_info_cache with network_info: [{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Creating tmpfile /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/tmpbtloc179 to verify with other compute node that the instance is on the same shared storage. {{(pid=71507) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:20 user nova-compute[71507]: WARNING nova.compute.manager [req-7b41b849-a592-400d-9334-f2189056c56f req-08d1b424-208e-47e3-87f9-8ee543a15ac4 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state resized and task_state resize_reverting.
Apr 13 15:22:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance destroyed successfully.
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'resources' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_vif [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c8ad360-aa, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:22:21 user nova-compute[71507]: INFO os_vif [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa')
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:22:21 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e001b-44df-4889-9e0a-bfb57b9fb836]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:22:21 user nova-compute[71507]: No targets found.
Apr 13 15:22:21 user nova-compute[71507]: iSNS:
Apr 13 15:22:21 user nova-compute[71507]: No targets found.
Apr 13 15:22:21 user nova-compute[71507]: STATIC:
Apr 13 15:22:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:22:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:22:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:22:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c
Apr 13 15:22:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:22:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:22:21 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f
Apr 13 15:22:21 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:22:21 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:22:21 user nova-compute[71507]: FIRMWARE:
Apr 13 15:22:21 user nova-compute[71507]: No targets found.
Apr 13 15:22:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:22:21 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:22:21 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba61bca-92e2-4ddc-9506-9ab040e4b9ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[04500f24-99f9-4452-b350-335998b49d9a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:22:21 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:22:21 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:22:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:22:21 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:22:21 user nova-compute[71507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:22:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c27a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f'): ({'sdg'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Removing single pathed devices sdg {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b61e947-826e-4d5f-8707-5383d318ecf7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c43994-d3bf-4e74-8c0a-78ccc0559078]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flushing IO for device /dev/sdg {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dc8159-df71-4f51-9085-475867e4dce4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bfef54-3924-49ca-95a3-7374c08b4fc0]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] SCSI volumes sdg have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9df7ba3-0b3c-421b-a8dd-05037606fe6d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7a97a-fb87-4250-835e-434c15cc3156]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]
Apr 13 15:22:21 user nova-compute[71507]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.
Apr 13 15:22:21 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea75c34-f11e-4413-b25f-f3bc9931d140]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== disconnect_volume: return (300ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:22:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updating instance_info_cache with network_info: [{"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-f54cffe3-73da-468b-8252-b74cb4ba9653" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'migration_context' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:22 user nova-compute[71507]: WARNING nova.compute.manager [req-5394d0e6-c4ff-4ab1-8251-00f5e77dd39a req-3eba52dd-0520-4772-a473-914b307ab4e3 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state resized and task_state resize_reverting.
Apr 13 15:22:22 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:22:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.365s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:23 user nova-compute[71507]: INFO nova.compute.manager [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Swapping old allocation on dict_keys(['d4bde90d-fb36-4cb3-9849-976dd28e1f71']) held by migration 99dd52ce-1c03-4b59-b1a2-872bc1613000 for instance
Apr 13 15:22:23 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Overwriting current allocation {'allocations': {'d4bde90d-fb36-4cb3-9849-976dd28e1f71': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 31}}, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'user_id': '3c12c62d4137473596571e523163e718', 'consumer_generation': 1} on consumer ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance_info_cache with network_info: [{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-ccc7b5bd-5f78-448e-bd82-74b2263dff75" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG os_brick.utils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b48bbe7-1791-493e-8211-14cdcd491ac7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[38daafa1-db2e-49da-9059-3a22a23c57a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3591aaa3-b4c7-48d7-8295-57c11fba1f0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d41007-33ef-464b-b7d7-16a05c8b54e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:22:23 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:22:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f3cf0b-3dac-46e4-83cb-c16d7a50809c]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:22:23 user nova-compute[71507]: DEBUG os_brick.utils [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:22:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:27 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399332.0558743, 1aa74d14-db6f-41f5-b8af-32da312209d3 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:22:27 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] VM Stopped (Lifecycle Event)
Apr 13 15:22:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2e228761-4fb3-4621-822b-cb9fcc3b3b3e None None] [instance: 1aa74d14-db6f-41f5-b8af-32da312209d3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Starting finish_revert_migration {{(pid=71507) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Start _get_guest_xml network_info=[{"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75', 'attached_at': '2023-04-13T15:22:29.000000', 'detached_at': '', 'volume_id': '23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'serial': '23e2b917-2efe-4a44-8c06-1a70d0c6d09f'}, 'attachment_id': '748770b2-1815-4f37-8f79-c82ed6bc1677', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:29 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:22:29 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'vcpu_model' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:22:29 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:22:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:22:29 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:22:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:22:29 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65b56c4-c2fd-4bd7-9123-66f8e36ebd46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:22:29 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b3de91-282a-495e-a2cb-cb00a87bd5e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f] added
Apr 13 15:22:29 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[545d1e1a-0989-470f-a79f-a94e7767f952]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dde23c-7355-4df9-8603-1b40d135c4d5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXpRLefv {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXpRLefv" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4658a7d6-349b-463c-ae4b-faa303730904]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXpRLefv'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64b5e6-8731-4bac-baa3-387b6cbf6a94]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81f3f73-64f2-4ac8-80cf-2b53cc787e43]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:22:30 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:22:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:22:30 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:22:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde37373-b944-4b39-ba80-b1ac76155caf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]
Apr 13 15:22:30 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.
Apr 13 15:22:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d40a194-57e6-40ad-8c14-f2d837626ac1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab60cf89-0503-4b8a-8c5b-1df7fafdecfb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:22:30 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:22:30 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:22:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:22:30 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:22:30 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:22:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cc4ece-9047-4363-a574-b529d68db017]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23862346631373431', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862346631373431', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:22:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:22:31 user nova-compute[71507]:   <uuid>ccc7b5bd-5f78-448e-bd82-74b2263dff75</uuid>
Apr 13 15:22:31 user nova-compute[71507]:   <name>instance-00000011</name>
Apr 13 15:22:31 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:22:31 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:22:31 user nova-compute[71507]:   <metadata>
Apr 13 15:22:31 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:22:31 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:22:31 user nova-compute[71507]:       <nova:name>tempest-ServerActionsTestJSON-server-2112327637</nova:name>
Apr 13 15:22:31 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:22:29</nova:creationTime>
Apr 13 15:22:31 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:22:31 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:22:31 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:22:31 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:22:31 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:22:31 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:22:31 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:22:31 user nova-compute[71507]:       <nova:owner>
Apr 13 15:22:31 user nova-compute[71507]:         <nova:user uuid="3c12c62d4137473596571e523163e718">tempest-ServerActionsTestJSON-423674903-project-member</nova:user>
Apr 13 15:22:31 user nova-compute[71507]:         <nova:project uuid="9154e4239a1a42a3820c27563ba0513f">tempest-ServerActionsTestJSON-423674903</nova:project>
Apr 13 15:22:31 user nova-compute[71507]:       </nova:owner>
Apr 13 15:22:31 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:22:31 user nova-compute[71507]:       <nova:ports>
Apr 13 15:22:31 user nova-compute[71507]:         <nova:port uuid="9c8ad360-aa62-4ef1-952f-d73f885baa89">
Apr 13 15:22:31 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 15:22:31 user nova-compute[71507]:         </nova:port>
Apr 13 15:22:31 user nova-compute[71507]:       </nova:ports>
Apr 13 15:22:31 user nova-compute[71507]:     </nova:instance>
Apr 13 15:22:31 user nova-compute[71507]:   </metadata>
Apr 13 15:22:31 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:22:31 user nova-compute[71507]:     <system>
Apr 13 15:22:31 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:22:31 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:22:31 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:22:31 user nova-compute[71507]:       <entry name="serial">ccc7b5bd-5f78-448e-bd82-74b2263dff75</entry>
Apr 13 15:22:31 user nova-compute[71507]:       <entry name="uuid">ccc7b5bd-5f78-448e-bd82-74b2263dff75</entry>
Apr 13 15:22:31 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:22:31 user nova-compute[71507]:     </system>
Apr 13 15:22:31 user nova-compute[71507]:   </sysinfo>
Apr 13 15:22:31 user nova-compute[71507]:   <os>
Apr 13 15:22:31 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:22:31 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:22:31 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:22:31 user nova-compute[71507]:   </os>
Apr 13 15:22:31 user nova-compute[71507]:   <features>
Apr 13 15:22:31 user nova-compute[71507]:     <acpi/>
Apr 13 15:22:31 user nova-compute[71507]:     <apic/>
Apr 13 15:22:31 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:22:31 user nova-compute[71507]:   </features>
Apr 13 15:22:31 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:22:31 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:22:31 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:22:31 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:22:31 user nova-compute[71507]:   </clock>
Apr 13 15:22:31 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:22:31 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:22:31 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:22:31 user nova-compute[71507]:   </cpu>
Apr 13 15:22:31 user nova-compute[71507]:   <devices>
Apr 13 15:22:31 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:22:31 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:22:31 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk"/>
Apr 13 15:22:31 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:22:31 user nova-compute[71507]:     </disk>
Apr 13 15:22:31 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:22:31 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:22:31 user nova-compute[71507]:       <source dev="/dev/sdc"/>
Apr 13 15:22:31 user nova-compute[71507]:       <target dev="vdb" bus="virtio"/>
Apr 13 15:22:31 user nova-compute[71507]:       <serial>23e2b917-2efe-4a44-8c06-1a70d0c6d09f</serial>
Apr 13 15:22:31 user nova-compute[71507]:     </disk>
Apr 13 15:22:31 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:22:31 user nova-compute[71507]:       <mac address="fa:16:3e:f7:02:ec"/>
Apr 13 15:22:31 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:22:31 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:22:31 user nova-compute[71507]:       <target dev="tap9c8ad360-aa"/>
Apr 13 15:22:31 user nova-compute[71507]:     </interface>
Apr 13 15:22:31 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:22:31 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/console.log" append="off"/>
Apr 13 15:22:31 user nova-compute[71507]:     </serial>
Apr 13 15:22:31 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:22:31 user nova-compute[71507]:     <video>
Apr 13 15:22:31 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:22:31 user nova-compute[71507]:     </video>
Apr 13 15:22:31 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:22:31 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:22:31 user nova-compute[71507]:     </rng>
Apr 13 15:22:31 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:22:31 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:22:31 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:22:31 user nova-compute[71507]:     </memballoon>
Apr 13 15:22:31 user nova-compute[71507]:   </devices>
Apr 13 15:22:31 user nova-compute[71507]: </domain>
Apr 13 15:22:31 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:22:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG os_vif [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c8ad360-aa, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c8ad360-aa, col_values=(('external_ids', {'iface-id': '9c8ad360-aa62-4ef1-952f-d73f885baa89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:02:ec', 'vm-uuid': 'ccc7b5bd-5f78-448e-bd82-74b2263dff75'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:31 user nova-compute[71507]: INFO os_vif [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa')
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:22:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8188MB free_disk=26.00466537475586GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 25f57234-8818-44d3-b476-d6cfba7b2810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:22:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:33 user nova-compute[71507]: INFO nova.compute.manager [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Terminating instance
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:33 user nova-compute[71507]: WARNING nova.compute.manager [req-e5b93338-6772-4b2a-b42f-6d8c059c7f1d req-daf0c073-e7b0-4f21-95bd-90641d07ad80 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state resized and task_state resize_reverting.
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-9da0e89e-d14a-4ab9-ae80-df3c2a3116cb req-4a0cefd4-fb5b-40de-ad61-8c4cb71b0265 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-unplugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:22:33 user nova-compute[71507]: INFO nova.compute.claims [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Claim successful on node user
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:22:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Instance destroyed successfully.
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.objects.instance [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'resources' on Instance uuid 8b883f51-b15c-42d7-b71a-e80c11e7d77e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1194728092',display_name='tempest-ServerRescueNegativeTestJSON-server-1194728092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1194728092',id=21,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK5IRXy1iREs5DJGXQd5/AwCvP1NHbH7B+ioRYx7R5/k6QdMWuWbYssq6+iYLG0++tDjS55HcQeDhgUv/EqHbP9wKGTtL2gyMe13XKrxk7Yzy8UBwjPqj14R6xUkbKGdQ==',key_name='tempest-keypair-1516441123',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-cfhhwyv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=8b883f51-b15c-42d7-b71a-e80c11e7d77e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "6343df00-b9ef-49a6-be1e-69f12895910f", "address": "fa:16:3e:96:84:55", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6343df00-b9", "ovs_interfaceid": "6343df00-b9ef-49a6-be1e-69f12895910f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:84:55,bridge_name='br-int',has_traffic_filtering=True,id=6343df00-b9ef-49a6-be1e-69f12895910f,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6343df00-b9') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG os_vif [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:84:55,bridge_name='br-int',has_traffic_filtering=True,id=6343df00-b9ef-49a6-be1e-69f12895910f,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6343df00-b9') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6343df00-b9, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:22:33 user nova-compute[71507]: INFO os_vif [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:84:55,bridge_name='br-int',has_traffic_filtering=True,id=6343df00-b9ef-49a6-be1e-69f12895910f,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6343df00-b9')
Apr 13 15:22:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Deleting instance files /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e_del
Apr 13 15:22:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Deletion of /opt/stack/data/nova/instances/8b883f51-b15c-42d7-b71a-e80c11e7d77e_del complete
Apr 13 15:22:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:22:34 user nova-compute[71507]: INFO nova.compute.manager [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.network.neutron [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:22:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.policy [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:22:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Creating image(s)
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "/opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "/opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "/opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk 1073741824" returned: 0 in 0.052s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:22:34 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Took 0.79 seconds to deallocate network for instance.
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Cannot resize image /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.objects.instance [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'migration_context' on Instance uuid 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Ensure instance console log exists: /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:34 user nova-compute[71507]: DEBUG nova.network.neutron [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Successfully created port: 714a062f-8189-4905-b41f-619554697056 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for ccc7b5bd-5f78-448e-bd82-74b2263dff75 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399355.177368, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:22:35 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] VM Resumed (Lifecycle Event)
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:22:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance running successfully.
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] finish_revert_migration finished successfully. {{(pid=71507) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:22:35 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399355.18238, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:22:35 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] VM Started (Lifecycle Event)
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:35 user nova-compute[71507]: WARNING nova.compute.manager [req-2b9b2993-f0fa-4b31-877b-a99e8009eb35 req-650a0e82-3837-4cbb-825f-8f75e108fc34 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state resized and task_state resize_reverting.
Apr 13 15:22:35 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Deleted allocations for instance 8b883f51-b15c-42d7-b71a-e80c11e7d77e
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:22:35 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f88732-92b8-4f26-8531-4097e4db060c tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.202s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:35 user nova-compute[71507]: INFO nova.compute.manager [None req-9aae592a-2734-485f-9ef6-800c89ee718a tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance to original state: 'active'
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] Acquiring lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] Lock "8b883f51-b15c-42d7-b71a-e80c11e7d77e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] No waiting events found dispatching network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:35 user nova-compute[71507]: WARNING nova.compute.manager [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received unexpected event network-vif-plugged-6343df00-b9ef-49a6-be1e-69f12895910f for instance with vm_state deleted and task_state None.
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f05f13d-8144-4034-800a-d4809307a5d2 req-5e0224e1-399b-4c22-bcb2-53b3138afbb3 service nova] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Received event network-vif-deleted-6343df00-b9ef-49a6-be1e-69f12895910f {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Successfully updated port: 714a062f-8189-4905-b41f-619554697056 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "refresh_cache-75a68333-dc4d-48d9-84c6-4c7cd515853e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquired lock "refresh_cache-75a68333-dc4d-48d9-84c6-4c7cd515853e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:22:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Updating instance_info_cache with network_info: [{"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Releasing lock "refresh_cache-75a68333-dc4d-48d9-84c6-4c7cd515853e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Instance network_info: |[{"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Start _get_guest_xml network_info=[{"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:22:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:22:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-462259660',display_name='tempest-AttachVolumeNegativeTest-server-462259660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-462259660',id=27,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCah+9H+8jh4CmJxEHYVZOlBpAJ3gCxsuGIfaDmRJo2gMuNYJKtf1qSAj9IJYkaI4lz+2Iyyk5h4jh7yZiU15svcNNYGaS/rHTOvo5L88SXHT9jfFzTOEqZvhKmOknO7Vg==',key_name='tempest-keypair-2093832726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-4de3fnki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:22:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=75a68333-dc4d-48d9-84c6-4c7cd515853e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:a0:3f,bridge_name='br-int',has_traffic_filtering=True,id=714a062f-8189-4905-b41f-619554697056,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714a062f-81') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'pci_devices' on Instance uuid 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:22:36 user nova-compute[71507]:   <uuid>75a68333-dc4d-48d9-84c6-4c7cd515853e</uuid>
Apr 13 15:22:36 user nova-compute[71507]:   <name>instance-0000001b</name>
Apr 13 15:22:36 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:22:36 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:22:36 user nova-compute[71507]:   <metadata>
Apr 13 15:22:36 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:22:36 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:22:36 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeNegativeTest-server-462259660</nova:name>
Apr 13 15:22:36 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:22:36</nova:creationTime>
Apr 13 15:22:36 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:22:36 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:22:36 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:22:36 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:22:36 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:22:36 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:22:36 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:22:36 user nova-compute[71507]:       <nova:owner>
Apr 13 15:22:36 user nova-compute[71507]:         <nova:user uuid="fedd34ccc15c47f9a4fc96b080730acd">tempest-AttachVolumeNegativeTest-416139458-project-member</nova:user>
Apr 13 15:22:36 user nova-compute[71507]:         <nova:project uuid="3e3ba2d132c445039d0ae30ffd2bc64a">tempest-AttachVolumeNegativeTest-416139458</nova:project>
Apr 13 15:22:36 user nova-compute[71507]:       </nova:owner>
Apr 13 15:22:36 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:22:36 user nova-compute[71507]:       <nova:ports>
Apr 13 15:22:36 user nova-compute[71507]:         <nova:port uuid="714a062f-8189-4905-b41f-619554697056">
Apr 13 15:22:36 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 15:22:36 user nova-compute[71507]:         </nova:port>
Apr 13 15:22:36 user nova-compute[71507]:       </nova:ports>
Apr 13 15:22:36 user nova-compute[71507]:     </nova:instance>
Apr 13 15:22:36 user nova-compute[71507]:   </metadata>
Apr 13 15:22:36 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:22:36 user nova-compute[71507]:     <system>
Apr 13 15:22:36 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:22:36 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:22:36 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:22:36 user nova-compute[71507]:       <entry name="serial">75a68333-dc4d-48d9-84c6-4c7cd515853e</entry>
Apr 13 15:22:36 user nova-compute[71507]:       <entry name="uuid">75a68333-dc4d-48d9-84c6-4c7cd515853e</entry>
Apr 13 15:22:36 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:22:36 user nova-compute[71507]:     </system>
Apr 13 15:22:36 user nova-compute[71507]:   </sysinfo>
Apr 13 15:22:36 user nova-compute[71507]:   <os>
Apr 13 15:22:36 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:22:36 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:22:36 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:22:36 user nova-compute[71507]:   </os>
Apr 13 15:22:36 user nova-compute[71507]:   <features>
Apr 13 15:22:36 user nova-compute[71507]:     <acpi/>
Apr 13 15:22:36 user nova-compute[71507]:     <apic/>
Apr 13 15:22:36 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:22:36 user nova-compute[71507]:   </features>
Apr 13 15:22:36 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:22:36 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:22:36 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:22:36 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:22:36 user nova-compute[71507]:   </clock>
Apr 13 15:22:36 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:22:36 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:22:36 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:22:36 user nova-compute[71507]:   </cpu>
Apr 13 15:22:36 user nova-compute[71507]:   <devices>
Apr 13 15:22:36 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:22:36 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:22:36 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk"/>
Apr 13 15:22:36 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:22:36 user nova-compute[71507]:     </disk>
Apr 13 15:22:36 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:22:36 user nova-compute[71507]:       <mac address="fa:16:3e:1c:a0:3f"/>
Apr 13 15:22:36 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:22:36 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:22:36 user nova-compute[71507]:       <target dev="tap714a062f-81"/>
Apr 13 15:22:36 user nova-compute[71507]:     </interface>
Apr 13 15:22:36 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:22:36 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/console.log" append="off"/>
Apr 13 15:22:36 user nova-compute[71507]:     </serial>
Apr 13 15:22:36 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:22:36 user nova-compute[71507]:     <video>
Apr 13 15:22:36 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:22:36 user nova-compute[71507]:     </video>
Apr 13 15:22:36 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:22:36 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:22:36 user nova-compute[71507]:     </rng>
Apr 13 15:22:36 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:22:36 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:22:36 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:22:36 user nova-compute[71507]:     </memballoon>
Apr 13 15:22:36 user nova-compute[71507]:   </devices>
Apr 13 15:22:36 user nova-compute[71507]: </domain>
Apr 13 15:22:36 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-462259660',display_name='tempest-AttachVolumeNegativeTest-server-462259660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-462259660',id=27,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCah+9H+8jh4CmJxEHYVZOlBpAJ3gCxsuGIfaDmRJo2gMuNYJKtf1qSAj9IJYkaI4lz+2Iyyk5h4jh7yZiU15svcNNYGaS/rHTOvo5L88SXHT9jfFzTOEqZvhKmOknO7Vg==',key_name='tempest-keypair-2093832726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-4de3fnki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:22:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=75a68333-dc4d-48d9-84c6-4c7cd515853e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:a0:3f,bridge_name='br-int',has_traffic_filtering=True,id=714a062f-8189-4905-b41f-619554697056,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714a062f-81') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG os_vif [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:a0:3f,bridge_name='br-int',has_traffic_filtering=True,id=714a062f-8189-4905-b41f-619554697056,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714a062f-81') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap714a062f-81, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap714a062f-81, col_values=(('external_ids', {'iface-id': '714a062f-8189-4905-b41f-619554697056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:a0:3f', 'vm-uuid': '75a68333-dc4d-48d9-84c6-4c7cd515853e'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:36 user nova-compute[71507]: INFO os_vif [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:a0:3f,bridge_name='br-int',has_traffic_filtering=True,id=714a062f-8189-4905-b41f-619554697056,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714a062f-81')
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:22:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No VIF found with MAC fa:16:3e:1c:a0:3f, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received event network-changed-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Refreshing instance network info cache due to event network-changed-714a062f-8189-4905-b41f-619554697056. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] Acquiring lock "refresh_cache-75a68333-dc4d-48d9-84c6-4c7cd515853e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] Acquired lock "refresh_cache-75a68333-dc4d-48d9-84c6-4c7cd515853e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Refreshing network info cache for port 714a062f-8189-4905-b41f-619554697056 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Updated VIF entry in instance network info cache for port 714a062f-8189-4905-b41f-619554697056. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Updating instance_info_cache with network_info: [{"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5a15a781-f9ae-48b6-9b7e-d4aab7302f1d req-7e58eef5-1300-4f9e-a976-56e705856c0c service nova] Releasing lock "refresh_cache-75a68333-dc4d-48d9-84c6-4c7cd515853e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received event network-vif-plugged-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] No waiting events found dispatching network-vif-plugged-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:37 user nova-compute[71507]: WARNING nova.compute.manager [req-cf50e3d8-bdec-482b-b884-d78de9d8e365 req-2ae30d2a-419a-4408-92b4-93534489f949 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received unexpected event network-vif-plugged-714a062f-8189-4905-b41f-619554697056 for instance with vm_state building and task_state spawning.
Apr 13 15:22:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399359.8359787, 75a68333-dc4d-48d9-84c6-4c7cd515853e => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:22:39 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] VM Resumed (Lifecycle Event)
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:22:39 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Instance spawned successfully.
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:22:39 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399359.8375373, 75a68333-dc4d-48d9-84c6-4c7cd515853e => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:22:39 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] VM Started (Lifecycle Event)
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:22:39 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:22:39 user nova-compute[71507]: INFO nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Took 5.74 seconds to spawn the instance on the hypervisor.
Apr 13 15:22:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received event network-vif-plugged-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] No waiting events found dispatching network-vif-plugged-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:40 user nova-compute[71507]: WARNING nova.compute.manager [req-e0e04e81-4981-4d4d-b3e0-8db9de51d201 req-710920d7-3ad2-4055-b82d-acb6141a9111 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received unexpected event network-vif-plugged-714a062f-8189-4905-b41f-619554697056 for instance with vm_state building and task_state spawning.
Apr 13 15:22:40 user nova-compute[71507]: INFO nova.compute.manager [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Took 6.57 seconds to build instance.
Apr 13 15:22:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6301e3be-6a01-4ff8-b185-260616a7b16c tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.712s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:46 user nova-compute[71507]: INFO nova.compute.manager [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Unrescuing
Apr 13 15:22:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:22:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquired lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:22:46 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG nova.network.neutron [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Updating instance_info_cache with network_info: [{"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Releasing lock "refresh_cache-c609c1d1-edcf-4b71-abea-5dd95ebcd81f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'flavor' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-unplugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-unplugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:47 user nova-compute[71507]: WARNING nova.compute.manager [req-bb408e9f-d568-44d7-b81e-101a36efc632 req-ad1c1ed9-1832-4314-8660-210ea16b7fc4 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-unplugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:22:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Instance destroyed successfully.
Apr 13 15:22:48 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399353.9328508, 8b883f51-b15c-42d7-b71a-e80c11e7d77e => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:22:48 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] VM Stopped (Lifecycle Event)
Apr 13 15:22:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-268beacf-fd3d-465a-9d8b-860e5b989d36 None None] [instance: 8b883f51-b15c-42d7-b71a-e80c11e7d77e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:49 user nova-compute[71507]: WARNING nova.compute.manager [req-b0ae72cf-e72e-40b8-b4ea-bb00f4e177d6 req-07f6faaa-c97d-41a5-abde-5cedc7fddfde service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state rescued and task_state unrescuing.
Apr 13 15:22:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for c609c1d1-edcf-4b71-abea-5dd95ebcd81f due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399371.822937, c609c1d1-edcf-4b71-abea-5dd95ebcd81f => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:22:51 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] VM Resumed (Lifecycle Event)
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a2899e85-1af0-4dc3-8b75-7679ae4b209d tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:22:51 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399371.824349, c609c1d1-edcf-4b71-abea-5dd95ebcd81f => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:22:51 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] VM Started (Lifecycle Event)
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:51 user nova-compute[71507]: WARNING nova.compute.manager [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state active and task_state None.
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:22:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:22:51 user nova-compute[71507]: WARNING nova.compute.manager [req-ea3a2d73-a626-4cfb-bfe6-cde116a61bad req-3f16141d-ae8c-4bad-8a8f-a5d5e80b272e service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state active and task_state None.
Apr 13 15:22:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:22:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:23:05 user nova-compute[71507]: INFO nova.compute.claims [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Claim successful on node user
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.143s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:23:05 user nova-compute[71507]: INFO nova.compute.claims [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Claim successful on node user
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:23:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:23:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Creating image(s)
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "/opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "/opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "/opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.policy [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de1a698b103a47c0b2864eef54be648b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceba33821a9b4f7aa81c2857c11261f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk 1073741824" returned: 0 in 0.073s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.policy [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:23:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Creating image(s)
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "/opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "/opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "/opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Cannot resize image /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'migration_context' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Successfully created port: 1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Ensure instance console log exists: /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk 1073741824" returned: 0 in 0.049s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Cannot resize image /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'migration_context' on Instance uuid 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Ensure instance console log exists: /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:06 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Successfully created port: 2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Successfully updated port: 1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "refresh_cache-f093cc8b-83cd-4154-8b4e-a98481e2c42a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquired lock "refresh_cache-f093cc8b-83cd-4154-8b4e-a98481e2c42a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-changed-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Refreshing instance network info cache due to event network-changed-1ef64389-9092-411b-a2cf-f0ad923650c5. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] Acquiring lock "refresh_cache-f093cc8b-83cd-4154-8b4e-a98481e2c42a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Successfully updated port: 2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquired lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received event network-changed-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Refreshing instance network info cache due to event network-changed-2fcc3406-d672-49a1-85b8-5f2ce187b541. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] Acquiring lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Updating instance_info_cache with network_info: [{"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Releasing lock "refresh_cache-f093cc8b-83cd-4154-8b4e-a98481e2c42a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Instance network_info: |[{"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] Acquired lock "refresh_cache-f093cc8b-83cd-4154-8b4e-a98481e2c42a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.neutron [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Refreshing network info cache for port 1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Start _get_guest_xml network_info=[{"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:23:07 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:23:07 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1518437861',display_name='tempest-AttachVolumeTestJSON-server-1518437861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1518437861',id=28,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdTSuvMCCSoO8gEL+Y4LzWCT6AMVJXqlSXautXO8WYI89z5mAhSWOc9+LI3QBpLskYzTiUPYNLmXCHJhNKKLvGDwdUolY7+TdNY3npIh3wlWQQVeSyeE6ZEta6F1YhiDA==',key_name='tempest-keypair-1855443748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-ytbuq5ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=f093cc8b-83cd-4154-8b4e-a98481e2c42a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:ba:8d,bridge_name='br-int',has_traffic_filtering=True,id=1ef64389-9092-411b-a2cf-f0ad923650c5,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef64389-90') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'pci_devices' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:23:07 user nova-compute[71507]:   <uuid>f093cc8b-83cd-4154-8b4e-a98481e2c42a</uuid>
Apr 13 15:23:07 user nova-compute[71507]:   <name>instance-0000001c</name>
Apr 13 15:23:07 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:23:07 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:23:07 user nova-compute[71507]:   <metadata>
Apr 13 15:23:07 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:23:07 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:23:07 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeTestJSON-server-1518437861</nova:name>
Apr 13 15:23:07 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:23:07</nova:creationTime>
Apr 13 15:23:07 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:23:07 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:23:07 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:23:07 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:23:07 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:23:07 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:23:07 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:23:07 user nova-compute[71507]:       <nova:owner>
Apr 13 15:23:07 user nova-compute[71507]:         <nova:user uuid="de1a698b103a47c0b2864eef54be648b">tempest-AttachVolumeTestJSON-157319562-project-member</nova:user>
Apr 13 15:23:07 user nova-compute[71507]:         <nova:project uuid="ceba33821a9b4f7aa81c2857c11261f1">tempest-AttachVolumeTestJSON-157319562</nova:project>
Apr 13 15:23:07 user nova-compute[71507]:       </nova:owner>
Apr 13 15:23:07 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:23:07 user nova-compute[71507]:       <nova:ports>
Apr 13 15:23:07 user nova-compute[71507]:         <nova:port uuid="1ef64389-9092-411b-a2cf-f0ad923650c5">
Apr 13 15:23:07 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 15:23:07 user nova-compute[71507]:         </nova:port>
Apr 13 15:23:07 user nova-compute[71507]:       </nova:ports>
Apr 13 15:23:07 user nova-compute[71507]:     </nova:instance>
Apr 13 15:23:07 user nova-compute[71507]:   </metadata>
Apr 13 15:23:07 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:23:07 user nova-compute[71507]:     <system>
Apr 13 15:23:07 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:23:07 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:23:07 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:23:07 user nova-compute[71507]:       <entry name="serial">f093cc8b-83cd-4154-8b4e-a98481e2c42a</entry>
Apr 13 15:23:07 user nova-compute[71507]:       <entry name="uuid">f093cc8b-83cd-4154-8b4e-a98481e2c42a</entry>
Apr 13 15:23:07 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:23:07 user nova-compute[71507]:     </system>
Apr 13 15:23:07 user nova-compute[71507]:   </sysinfo>
Apr 13 15:23:07 user nova-compute[71507]:   <os>
Apr 13 15:23:07 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:23:07 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:23:07 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:23:07 user nova-compute[71507]:   </os>
Apr 13 15:23:07 user nova-compute[71507]:   <features>
Apr 13 15:23:07 user nova-compute[71507]:     <acpi/>
Apr 13 15:23:07 user nova-compute[71507]:     <apic/>
Apr 13 15:23:07 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:23:07 user nova-compute[71507]:   </features>
Apr 13 15:23:07 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:23:07 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:23:07 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:23:07 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:23:07 user nova-compute[71507]:   </clock>
Apr 13 15:23:07 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:23:07 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:23:07 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:23:07 user nova-compute[71507]:   </cpu>
Apr 13 15:23:07 user nova-compute[71507]:   <devices>
Apr 13 15:23:07 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:23:07 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:23:07 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk"/>
Apr 13 15:23:07 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:23:07 user nova-compute[71507]:     </disk>
Apr 13 15:23:07 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:23:07 user nova-compute[71507]:       <mac address="fa:16:3e:ed:ba:8d"/>
Apr 13 15:23:07 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:23:07 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:23:07 user nova-compute[71507]:       <target dev="tap1ef64389-90"/>
Apr 13 15:23:07 user nova-compute[71507]:     </interface>
Apr 13 15:23:07 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:23:07 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/console.log" append="off"/>
Apr 13 15:23:07 user nova-compute[71507]:     </serial>
Apr 13 15:23:07 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:23:07 user nova-compute[71507]:     <video>
Apr 13 15:23:07 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:23:07 user nova-compute[71507]:     </video>
Apr 13 15:23:07 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:23:07 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:23:07 user nova-compute[71507]:     </rng>
Apr 13 15:23:07 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:23:07 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:23:07 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:23:07 user nova-compute[71507]:     </memballoon>
Apr 13 15:23:07 user nova-compute[71507]:   </devices>
Apr 13 15:23:07 user nova-compute[71507]: </domain>
Apr 13 15:23:07 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1518437861',display_name='tempest-AttachVolumeTestJSON-server-1518437861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1518437861',id=28,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdTSuvMCCSoO8gEL+Y4LzWCT6AMVJXqlSXautXO8WYI89z5mAhSWOc9+LI3QBpLskYzTiUPYNLmXCHJhNKKLvGDwdUolY7+TdNY3npIh3wlWQQVeSyeE6ZEta6F1YhiDA==',key_name='tempest-keypair-1855443748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-ytbuq5ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=f093cc8b-83cd-4154-8b4e-a98481e2c42a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:ba:8d,bridge_name='br-int',has_traffic_filtering=True,id=1ef64389-9092-411b-a2cf-f0ad923650c5,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef64389-90') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG os_vif [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:ba:8d,bridge_name='br-int',has_traffic_filtering=True,id=1ef64389-9092-411b-a2cf-f0ad923650c5,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef64389-90') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ef64389-90, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ef64389-90, col_values=(('external_ids', {'iface-id': '1ef64389-9092-411b-a2cf-f0ad923650c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:ba:8d', 'vm-uuid': 'f093cc8b-83cd-4154-8b4e-a98481e2c42a'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:07 user nova-compute[71507]: INFO os_vif [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:ba:8d,bridge_name='br-int',has_traffic_filtering=True,id=1ef64389-9092-411b-a2cf-f0ad923650c5,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef64389-90')
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:23:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No VIF found with MAC fa:16:3e:ed:ba:8d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updating instance_info_cache with network_info: [{"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Releasing lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Instance network_info: |[{"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] Acquired lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Refreshing network info cache for port 2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Start _get_guest_xml network_info=[{"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:23:08 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:23:08 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-220855040',display_name='tempest-TestStampPattern-server-220855040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-220855040',id=29,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAksZCequnPeyEoxbRX4FTqaIZECithWpaNGXiycVZEBPtiDQC3OzUbnYo2ImPDa8dvWI39XTOjrHTgd99yZNpia3NMbHa+IllMmi0NURtQ7qbFcLr5JTdfFUpnNv2P7uA==',key_name='tempest-TestStampPattern-1982719940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318b9e0eb6a745df811d1daa4d6195fc',ramdisk_id='',reservation_id='r-kajdv5k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1572934421',owner_user_name='tempest-TestStampPattern-1572934421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:23:06Z,user_data=None,user_id='78e289648c244c77ab9ca48154da3cde',uuid=42464137-e247-4191-8ed4-4bbdbe392f95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converting VIF {"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fcc3406-d672-49a1-85b8-5f2ce187b541,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fcc3406-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'pci_devices' on Instance uuid 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:23:08 user nova-compute[71507]:   <uuid>42464137-e247-4191-8ed4-4bbdbe392f95</uuid>
Apr 13 15:23:08 user nova-compute[71507]:   <name>instance-0000001d</name>
Apr 13 15:23:08 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:23:08 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:23:08 user nova-compute[71507]:   <metadata>
Apr 13 15:23:08 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:23:08 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:23:08 user nova-compute[71507]:       <nova:name>tempest-TestStampPattern-server-220855040</nova:name>
Apr 13 15:23:08 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:23:08</nova:creationTime>
Apr 13 15:23:08 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:23:08 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:23:08 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:23:08 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:23:08 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:23:08 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:23:08 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:23:08 user nova-compute[71507]:       <nova:owner>
Apr 13 15:23:08 user nova-compute[71507]:         <nova:user uuid="78e289648c244c77ab9ca48154da3cde">tempest-TestStampPattern-1572934421-project-member</nova:user>
Apr 13 15:23:08 user nova-compute[71507]:         <nova:project uuid="318b9e0eb6a745df811d1daa4d6195fc">tempest-TestStampPattern-1572934421</nova:project>
Apr 13 15:23:08 user nova-compute[71507]:       </nova:owner>
Apr 13 15:23:08 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:23:08 user nova-compute[71507]:       <nova:ports>
Apr 13 15:23:08 user nova-compute[71507]:         <nova:port uuid="2fcc3406-d672-49a1-85b8-5f2ce187b541">
Apr 13 15:23:08 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 15:23:08 user nova-compute[71507]:         </nova:port>
Apr 13 15:23:08 user nova-compute[71507]:       </nova:ports>
Apr 13 15:23:08 user nova-compute[71507]:     </nova:instance>
Apr 13 15:23:08 user nova-compute[71507]:   </metadata>
Apr 13 15:23:08 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:23:08 user nova-compute[71507]:     <system>
Apr 13 15:23:08 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:23:08 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:23:08 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:23:08 user nova-compute[71507]:       <entry name="serial">42464137-e247-4191-8ed4-4bbdbe392f95</entry>
Apr 13 15:23:08 user nova-compute[71507]:       <entry name="uuid">42464137-e247-4191-8ed4-4bbdbe392f95</entry>
Apr 13 15:23:08 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:23:08 user nova-compute[71507]:     </system>
Apr 13 15:23:08 user nova-compute[71507]:   </sysinfo>
Apr 13 15:23:08 user nova-compute[71507]:   <os>
Apr 13 15:23:08 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:23:08 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:23:08 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:23:08 user nova-compute[71507]:   </os>
Apr 13 15:23:08 user nova-compute[71507]:   <features>
Apr 13 15:23:08 user nova-compute[71507]:     <acpi/>
Apr 13 15:23:08 user nova-compute[71507]:     <apic/>
Apr 13 15:23:08 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:23:08 user nova-compute[71507]:   </features>
Apr 13 15:23:08 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:23:08 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:23:08 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:23:08 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:23:08 user nova-compute[71507]:   </clock>
Apr 13 15:23:08 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:23:08 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:23:08 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:23:08 user nova-compute[71507]:   </cpu>
Apr 13 15:23:08 user nova-compute[71507]:   <devices>
Apr 13 15:23:08 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:23:08 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:23:08 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk"/>
Apr 13 15:23:08 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:23:08 user nova-compute[71507]:     </disk>
Apr 13 15:23:08 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:23:08 user nova-compute[71507]:       <mac address="fa:16:3e:a6:9a:cd"/>
Apr 13 15:23:08 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:23:08 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:23:08 user nova-compute[71507]:       <target dev="tap2fcc3406-d6"/>
Apr 13 15:23:08 user nova-compute[71507]:     </interface>
Apr 13 15:23:08 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:23:08 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/console.log" append="off"/>
Apr 13 15:23:08 user nova-compute[71507]:     </serial>
Apr 13 15:23:08 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:23:08 user nova-compute[71507]:     <video>
Apr 13 15:23:08 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:23:08 user nova-compute[71507]:     </video>
Apr 13 15:23:08 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:23:08 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:23:08 user nova-compute[71507]:     </rng>
Apr 13 15:23:08 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:23:08 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:23:08 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:23:08 user nova-compute[71507]:     </memballoon>
Apr 13 15:23:08 user nova-compute[71507]:   </devices>
Apr 13 15:23:08 user nova-compute[71507]: </domain>
Apr 13 15:23:08 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-220855040',display_name='tempest-TestStampPattern-server-220855040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-220855040',id=29,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAksZCequnPeyEoxbRX4FTqaIZECithWpaNGXiycVZEBPtiDQC3OzUbnYo2ImPDa8dvWI39XTOjrHTgd99yZNpia3NMbHa+IllMmi0NURtQ7qbFcLr5JTdfFUpnNv2P7uA==',key_name='tempest-TestStampPattern-1982719940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318b9e0eb6a745df811d1daa4d6195fc',ramdisk_id='',reservation_id='r-kajdv5k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1572934421',owner_user_name='tempest-TestStampPattern-1572934421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:23:06Z,user_data=None,user_id='78e289648c244c77ab9ca48154da3cde',uuid=42464137-e247-4191-8ed4-4bbdbe392f95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converting VIF {"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fcc3406-d672-49a1-85b8-5f2ce187b541,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fcc3406-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG os_vif [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fcc3406-d672-49a1-85b8-5f2ce187b541,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fcc3406-d6') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fcc3406-d6, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fcc3406-d6, col_values=(('external_ids', {'iface-id': '2fcc3406-d672-49a1-85b8-5f2ce187b541', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:9a:cd', 'vm-uuid': '42464137-e247-4191-8ed4-4bbdbe392f95'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:08 user nova-compute[71507]: INFO os_vif [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fcc3406-d672-49a1-85b8-5f2ce187b541,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fcc3406-d6')
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No VIF found with MAC fa:16:3e:a6:9a:cd, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Updated VIF entry in instance network info cache for port 1ef64389-9092-411b-a2cf-f0ad923650c5. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Updating instance_info_cache with network_info: [{"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-39ab201e-aa4a-4922-ab64-6c3407fb6023 req-3db57c19-d078-42a8-a1f4-f3d2842bd3f8 service nova] Releasing lock "refresh_cache-f093cc8b-83cd-4154-8b4e-a98481e2c42a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updated VIF entry in instance network info cache for port 2fcc3406-d672-49a1-85b8-5f2ce187b541. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updating instance_info_cache with network_info: [{"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:23:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d8327b6a-89f0-47d1-80ef-e4a363fbaf8c req-3e4459f6-503b-4206-ae54-8a2a790a4796 service nova] Releasing lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] No waiting events found dispatching network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:23:10 user nova-compute[71507]: WARNING nova.compute.manager [req-f15e76a8-1ade-4115-ac30-22a08f1c0a50 req-138ca901-caee-4645-98f7-29ab62f418a8 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received unexpected event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 for instance with vm_state building and task_state spawning.
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received event network-vif-plugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] No waiting events found dispatching network-vif-plugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:23:10 user nova-compute[71507]: WARNING nova.compute.manager [req-3e81a012-c9bd-460e-965f-0b7e350f7716 req-2992e1be-bf10-464b-9465-85f78d6a5a2d service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received unexpected event network-vif-plugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance with vm_state building and task_state spawning.
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] No waiting events found dispatching network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:23:12 user nova-compute[71507]: WARNING nova.compute.manager [req-9e801c9d-18d2-46b8-aae2-fce9fc578fad req-470aebbf-6149-4aa3-b768-a7cce39f6ffe service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received unexpected event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 for instance with vm_state building and task_state spawning.
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received event network-vif-plugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] No waiting events found dispatching network-vif-plugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:23:12 user nova-compute[71507]: WARNING nova.compute.manager [req-08de6a90-02fc-4490-9989-03493214a6a0 req-5d8e5f1e-dbd9-48a0-91f7-2bc86727aad8 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received unexpected event network-vif-plugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance with vm_state building and task_state spawning.
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399392.8673983, f093cc8b-83cd-4154-8b4e-a98481e2c42a => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:23:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] VM Resumed (Lifecycle Event)
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:23:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Instance spawned successfully.
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:23:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399392.869155, f093cc8b-83cd-4154-8b4e-a98481e2c42a => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:23:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] VM Started (Lifecycle Event)
Apr 13 15:23:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Instance spawned successfully.
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:23:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:23:12 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399392.9105573, 42464137-e247-4191-8ed4-4bbdbe392f95 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:23:12 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] VM Resumed (Lifecycle Event)
Apr 13 15:23:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:23:13 user nova-compute[71507]: INFO nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Took 6.74 seconds to spawn the instance on the hypervisor.
Apr 13 15:23:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:23:13 user nova-compute[71507]: INFO nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Took 7.34 seconds to spawn the instance on the hypervisor.
Apr 13 15:23:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:23:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:23:13 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:23:13 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399392.9156516, 42464137-e247-4191-8ed4-4bbdbe392f95 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:23:13 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] VM Started (Lifecycle Event)
Apr 13 15:23:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:23:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:23:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:13 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:23:13 user nova-compute[71507]: INFO nova.compute.manager [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Took 8.08 seconds to build instance.
Apr 13 15:23:13 user nova-compute[71507]: INFO nova.compute.manager [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Took 7.82 seconds to build instance.
Apr 13 15:23:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f1e30631-8dfd-4943-acd5-5e40b1e965a5 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.194s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9d0fb5d-5061-4419-bb62-4e62dcb348c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.916s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:19 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances with incomplete migration  {{(pid=71507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 15:23:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:23:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:23:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:23:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:23:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updating instance_info_cache with network_info: [{"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:23:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-25f57234-8818-44d3-b476-d6cfba7b2810" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:23:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:23:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] There are 0 instances to clean {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "25f57234-8818-44d3-b476-d6cfba7b2810" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:28 user nova-compute[71507]: INFO nova.compute.manager [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Terminating instance
Apr 13 15:23:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:23:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.compute.manager [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-unplugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.compute.manager [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] No waiting events found dispatching network-vif-unplugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.compute.manager [req-7c919430-011e-4778-b111-1fdb3996ad82 req-ef5813fc-fe61-43a7-9816-70d8995ff0bd service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-unplugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:23:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Instance destroyed successfully.
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'resources' on Instance uuid 25f57234-8818-44d3-b476-d6cfba7b2810 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-842194501',display_name='tempest-ServerRescueNegativeTestJSON-server-842194501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-842194501',id=3,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:09:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-lsu3syxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:09:26Z,user_data=None,user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=25f57234-8818-44d3-b476-d6cfba7b2810,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "address": "fa:16:3e:c7:dd:13", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b886a7-88", "ovs_interfaceid": "e4b886a7-88e3-42e3-98b8-b0fa9d67391a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=e4b886a7-88e3-42e3-98b8-b0fa9d67391a,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b886a7-88') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG os_vif [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=e4b886a7-88e3-42e3-98b8-b0fa9d67391a,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b886a7-88') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4b886a7-88, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:29 user nova-compute[71507]: INFO os_vif [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:dd:13,bridge_name='br-int',has_traffic_filtering=True,id=e4b886a7-88e3-42e3-98b8-b0fa9d67391a,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b886a7-88')
Apr 13 15:23:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Deleting instance files /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810_del
Apr 13 15:23:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Deletion of /opt/stack/data/nova/instances/25f57234-8818-44d3-b476-d6cfba7b2810_del complete
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:23:29 user nova-compute[71507]: INFO nova.compute.manager [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:23:30 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Took 0.55 seconds to deallocate network for instance.
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:30 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Deleted allocations for instance 25f57234-8818-44d3-b476-d6cfba7b2810
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-34dc01cf-cc2c-4add-b628-f09684849b67 tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "25f57234-8818-44d3-b476-d6cfba7b2810" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] Acquiring lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] Lock "25f57234-8818-44d3-b476-d6cfba7b2810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] No waiting events found dispatching network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:23:31 user nova-compute[71507]: WARNING nova.compute.manager [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received unexpected event network-vif-plugged-e4b886a7-88e3-42e3-98b8-b0fa9d67391a for instance with vm_state deleted and task_state None.
Apr 13 15:23:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-3c1ee205-e3de-417e-a6c9-7ef35f3108c6 req-1c64f328-d570-43cc-85f7-60e6ccf21b4b service nova] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Received event network-vif-deleted-e4b886a7-88e3-42e3-98b8-b0fa9d67391a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:23:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:23:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7802MB free_disk=26.039119720458984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f54cffe3-73da-468b-8252-b74cb4ba9653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 42464137-e247-4191-8ed4-4bbdbe392f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing inventories for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating ProviderTree inventory for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 15:23:32 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:23:33 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing aggregate associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, aggregates: None {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 15:23:33 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing trait associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 15:23:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:33 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:23:33 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:23:33 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:23:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:23:37 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:37 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:44 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399409.4958022, 25f57234-8818-44d3-b476-d6cfba7b2810 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:23:44 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] VM Stopped (Lifecycle Event)
Apr 13 15:23:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cc934691-c99b-4c38-be74-99b65e994f7a None None] [instance: 25f57234-8818-44d3-b476-d6cfba7b2810] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:23:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:23:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:23:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_power_states {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 149f8be9-79d3-4922-b3cc-c164b8b81534 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "0a0a9548-9e57-4007-bafb-d418a4433473" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "149f8be9-79d3-4922-b3cc-c164b8b81534" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "0a0a9548-9e57-4007-bafb-d418a4433473" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:23:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:24:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:24:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:24:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:24:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:24:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:24:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:24:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:24:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:19 user nova-compute[71507]: INFO nova.compute.manager [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Terminating instance
Apr 13 15:24:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Instance destroyed successfully.
Apr 13 15:24:20 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lazy-loading 'resources' on Instance uuid f54cffe3-73da-468b-8252-b74cb4ba9653 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-848115608',display_name='tempest-ServerRescueNegativeTestJSON-server-848115608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-848115608',id=2,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bad96fcfa0d4691af2a7990ba9dbd09',ramdisk_id='',reservation_id='r-q6b0p4z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66620130',owner_user_name='tempest-ServerRescueNegativeTestJSON-66620130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:14:08Z,user_data=None,user_id='c83940ddaaf64d94b40df9d00349aa91',uuid=f54cffe3-73da-468b-8252-b74cb4ba9653,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converting VIF {"id": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "address": "fa:16:3e:45:ab:a1", "network": {"id": "434a74f0-0d97-44db-bbc8-2c5b3599caab", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-539975331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bad96fcfa0d4691af2a7990ba9dbd09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9b23f6-72", "ovs_interfaceid": "0d9b23f6-72f8-44b8-bf33-5abc1543e18d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:ab:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d9b23f6-72f8-44b8-bf33-5abc1543e18d,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9b23f6-72') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG os_vif [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:ab:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d9b23f6-72f8-44b8-bf33-5abc1543e18d,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9b23f6-72') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d9b23f6-72, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:24:20 user nova-compute[71507]: INFO os_vif [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:ab:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d9b23f6-72f8-44b8-bf33-5abc1543e18d,network=Network(434a74f0-0d97-44db-bbc8-2c5b3599caab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9b23f6-72')
Apr 13 15:24:20 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Deleting instance files /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653_del
Apr 13 15:24:20 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Deletion of /opt/stack/data/nova/instances/f54cffe3-73da-468b-8252-b74cb4ba9653_del complete
Apr 13 15:24:20 user nova-compute[71507]: INFO nova.compute.manager [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Took 0.73 seconds to destroy the instance on the hypervisor.
Apr 13 15:24:20 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-efc41e39-bead-44a6-a634-5f13cdba0d3b req-62ab4654-e971-4445-9fca-2225bd3eb256 service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-unplugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:24:21 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Took 0.96 seconds to deallocate network for instance.
Apr 13 15:24:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:21 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Deleted allocations for instance f54cffe3-73da-468b-8252-b74cb4ba9653
Apr 13 15:24:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b9e0db31-84c7-4433-8531-f511ac228aeb tempest-ServerRescueNegativeTestJSON-66620130 tempest-ServerRescueNegativeTestJSON-66620130-project-member] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:24:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:24:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updating instance_info_cache with network_info: [{"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:24:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:24:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:24:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:24:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] Acquiring lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] Lock "f54cffe3-73da-468b-8252-b74cb4ba9653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] No waiting events found dispatching network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:24:22 user nova-compute[71507]: WARNING nova.compute.manager [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received unexpected event network-vif-plugged-0d9b23f6-72f8-44b8-bf33-5abc1543e18d for instance with vm_state deleted and task_state None.
Apr 13 15:24:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-19826ae9-ea02-48d5-99e1-8e47b0e914da req-e33e4904-b6df-4876-9d61-9e9389c0788b service nova] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Received event network-vif-deleted-0d9b23f6-72f8-44b8-bf33-5abc1543e18d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:24:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received event network-changed-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:24:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Refreshing instance network info cache due to event network-changed-714a062f-8189-4905-b41f-619554697056. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:24:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] Acquiring lock "refresh_cache-75a68333-dc4d-48d9-84c6-4c7cd515853e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:24:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] Acquired lock "refresh_cache-75a68333-dc4d-48d9-84c6-4c7cd515853e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:24:24 user nova-compute[71507]: DEBUG nova.network.neutron [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Refreshing network info cache for port 714a062f-8189-4905-b41f-619554697056 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG nova.network.neutron [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Updated VIF entry in instance network info cache for port 714a062f-8189-4905-b41f-619554697056. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG nova.network.neutron [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Updating instance_info_cache with network_info: [{"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5e9c65c3-023b-4e66-8ad3-2fa9a8112630 req-2a77e768-5bf8-4982-b690-dc4a959f6e6c service nova] Releasing lock "refresh_cache-75a68333-dc4d-48d9-84c6-4c7cd515853e" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'flavor' on Instance uuid 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:25 user nova-compute[71507]: INFO nova.compute.manager [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Attaching volume 2d95ff23-b0db-4607-a1cb-45efab22658d to /dev/vdb
Apr 13 15:24:25 user nova-compute[71507]: DEBUG os_brick.utils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6985e40b-5398-4808-9966-0f4930c37ca4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d768e7b3-26af-4fb4-b106-baa0e6889d98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee5015-7b84-4241-b8b3-003032244ad3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5633d46-e923-41bf-8abe-a7ac1326ce0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:24:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:24:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:24:26 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:24:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29f8c5e-afcb-486b-83b1-d42cb07357e5]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:24:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:24:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:24:26 user nova-compute[71507]: DEBUG os_brick.utils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:24:26 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Updating existing volume attachment record: 0a084b43-c43d-41f0-b45d-717d54b89ef2 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:24:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:29 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:24:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:29 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:24:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:24:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'khZAOWxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:24:30 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:24:30 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:24:30 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4cda6e-7480-433b-977b-bd2a2ed27977]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:24:30 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[26edc877-6bc3-4021-9997-b135ef02fc7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d] added
Apr 13 15:24:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db41a8f-9534-4a16-bdc2-e05286b6b4af]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[606b52b4-04e5-4e6c-adde-0aafe159c5fe]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v khZAOWxM {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v khZAOWxM" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b7854b-ce9c-44fa-81aa-89df7633d543]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'khZAOWxM'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9363a337-e135-4435-9d5c-afe002e54804]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd41704-ca28-41eb-a039-d54b7131a5ab]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:24:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:24:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f930d7e-55c9-4ac2-bd9a-b27204917b7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d, portal: 172.16.0.220,3260]
Apr 13 15:24:30 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d, portal: 172.16.0.220,3260] successful.
Apr 13 15:24:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[26134c1e-d376-43fb-b520-d5d7a4c21f7a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[920dbacc-398a-4e0b-841d-82668d000991]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d (non-flash)
Apr 13 15:24:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:24:30 user nova-compute[71507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d (non-flash)
Apr 13 15:24:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbb3079-bc83-4761-bf24-186e58cf65ec]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'khZAOWxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26462383963393130', 'path': '/dev/sde'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462383963393130', 'path': '/dev/sde'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG nova.objects.instance [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'flavor' on Instance uuid 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:24:31 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:24:31 user nova-compute[71507]:   <source dev="/dev/sde"/>
Apr 13 15:24:31 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:24:31 user nova-compute[71507]:   <serial>2d95ff23-b0db-4607-a1cb-45efab22658d</serial>
Apr 13 15:24:31 user nova-compute[71507]: </disk>
Apr 13 15:24:31 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:24:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:24:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=26.05746078491211GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No VIF found with MAC fa:16:3e:1c:a0:3f, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 149f8be9-79d3-4922-b3cc-c164b8b81534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ccc7b5bd-5f78-448e-bd82-74b2263dff75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 75a68333-dc4d-48d9-84c6-4c7cd515853e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance f093cc8b-83cd-4154-8b4e-a98481e2c42a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 42464137-e247-4191-8ed4-4bbdbe392f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-fd19344f-725c-448c-b75d-aa692ac0a44d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.809s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:24:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:33 user nova-compute[71507]: INFO nova.compute.manager [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Detaching volume 2d95ff23-b0db-4607-a1cb-45efab22658d
Apr 13 15:24:33 user nova-compute[71507]: INFO nova.virt.block_device [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Attempting to driver detach volume 2d95ff23-b0db-4607-a1cb-45efab22658d from mountpoint /dev/vdb
Apr 13 15:24:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Attempting to detach device vdb from instance 75a68333-dc4d-48d9-84c6-4c7cd515853e from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:24:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:24:33 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:24:33 user nova-compute[71507]:   <source dev="/dev/sde"/>
Apr 13 15:24:33 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:24:33 user nova-compute[71507]:   <serial>2d95ff23-b0db-4607-a1cb-45efab22658d</serial>
Apr 13 15:24:33 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:24:33 user nova-compute[71507]: </disk>
Apr 13 15:24:33 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:24:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully detached device vdb from instance 75a68333-dc4d-48d9-84c6-4c7cd515853e from the persistent domain config.
Apr 13 15:24:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75a68333-dc4d-48d9-84c6-4c7cd515853e from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:24:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:24:33 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:24:33 user nova-compute[71507]:   <source dev="/dev/sde"/>
Apr 13 15:24:33 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:24:33 user nova-compute[71507]:   <serial>2d95ff23-b0db-4607-a1cb-45efab22658d</serial>
Apr 13 15:24:33 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:24:33 user nova-compute[71507]: </disk>
Apr 13 15:24:33 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399474.3225765, 75a68333-dc4d-48d9-84c6-4c7cd515853e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:24:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully detached device vdb from instance 75a68333-dc4d-48d9-84c6-4c7cd515853e from the live domain config.
Apr 13 15:24:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'khZAOWxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:24:34 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc91ac3-ad03-4bff-8530-1ffdd75b7457]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:24:34 user nova-compute[71507]: No targets found.
Apr 13 15:24:34 user nova-compute[71507]: iSNS:
Apr 13 15:24:34 user nova-compute[71507]: No targets found.
Apr 13 15:24:34 user nova-compute[71507]: STATIC:
Apr 13 15:24:34 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:24:34 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:24:34 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:24:34 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d
Apr 13 15:24:34 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:24:34 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:24:34 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c
Apr 13 15:24:34 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:24:34 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:24:34 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f
Apr 13 15:24:34 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:24:34 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:24:34 user nova-compute[71507]: FIRMWARE:
Apr 13 15:24:34 user nova-compute[71507]: No targets found.
Apr 13 15:24:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:24:34 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:24:34 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fa040d-8756-43c8-ad71-fe26bf70df69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6752e958-3782-49e8-8d88-d15d1c322f8c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:24:34 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:24:34 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:24:34 user nova-compute[71507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d (non-flash)
Apr 13 15:24:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:24:34 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:24:34 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:24:34 user nova-compute[71507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d (non-flash)
Apr 13 15:24:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c27ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d'): ({'sde'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Removing single pathed devices sde {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1339991c-6a81-42ea-a83c-8b105f75dc16]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[233bb94e-b701-43f6-89bf-122cd1797392]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flushing IO for device /dev/sde {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[141961f9-0a4b-4dd2-9f5e-3c37b95004ff]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.308s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[40323106-82c5-4a28-adee-82f2c5a6ed1a]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd73945-cd0e-4e53-8f3c-97448710b8f4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2afa42e-4179-4823-830d-9802bc881492]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d, portal: 172.16.0.220,3260]
Apr 13 15:24:34 user nova-compute[71507]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d, portal: 172.16.0.220,3260] successful.
Apr 13 15:24:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d95ff23-b0db-4607-a1cb-45efab22658d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd87425a-f977-4ded-80d7-9a1e289ab751]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.563s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] <== disconnect_volume: return (564ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:24:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:24:35 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399460.062893, f54cffe3-73da-468b-8252-b74cb4ba9653 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:24:35 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] VM Stopped (Lifecycle Event)
Apr 13 15:24:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-08d58ee5-5805-4dae-883b-dd71851a73b4 None None] [instance: f54cffe3-73da-468b-8252-b74cb4ba9653] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:24:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:24:35 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'flavor' on Instance uuid 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:24:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e66fe4f0-ef22-463f-ac89-21c46ba4964a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.847s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:37 user nova-compute[71507]: INFO nova.compute.manager [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Terminating instance
Apr 13 15:24:37 user nova-compute[71507]: DEBUG nova.compute.manager [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-unplugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-unplugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:24:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-66ad0c3e-e57e-42e4-a45e-c84f4620792e req-50aef839-f7c7-4e6f-94e5-a8a838214b65 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-unplugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:38 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Instance destroyed successfully.
Apr 13 15:24:38 user nova-compute[71507]: DEBUG nova.objects.instance [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'resources' on Instance uuid c609c1d1-edcf-4b71-abea-5dd95ebcd81f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82933329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82933329',id=26,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:21:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-mpki9sme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:22:52Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=c609c1d1-edcf-4b71-abea-5dd95ebcd81f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "address": "fa:16:3e:e2:51:fe", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d492eb-f3", "ovs_interfaceid": "92d492eb-f3b6-4481-b492-949cf7eabd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:51:fe,bridge_name='br-int',has_traffic_filtering=True,id=92d492eb-f3b6-4481-b492-949cf7eabd1a,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d492eb-f3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_vif [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:51:fe,bridge_name='br-int',has_traffic_filtering=True,id=92d492eb-f3b6-4481-b492-949cf7eabd1a,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d492eb-f3') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92d492eb-f3, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:24:38 user nova-compute[71507]: INFO os_vif [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:51:fe,bridge_name='br-int',has_traffic_filtering=True,id=92d492eb-f3b6-4481-b492-949cf7eabd1a,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d492eb-f3')
Apr 13 15:24:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnmljsyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:24:38 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ba24f2-03e6-49ea-b1d5-ed57b885f24d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:24:38 user nova-compute[71507]: No targets found.
Apr 13 15:24:38 user nova-compute[71507]: iSNS:
Apr 13 15:24:38 user nova-compute[71507]: No targets found.
Apr 13 15:24:38 user nova-compute[71507]: STATIC:
Apr 13 15:24:38 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:24:38 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:24:38 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:24:38 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c
Apr 13 15:24:38 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:24:38 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:24:38 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f
Apr 13 15:24:38 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:24:38 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:24:38 user nova-compute[71507]: FIRMWARE:
Apr 13 15:24:38 user nova-compute[71507]: No targets found.
Apr 13 15:24:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:24:38 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:24:38 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ff840f-e8cf-4b89-a6d5-bd1500c49509]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2ef6c0-bfd5-4cc8-996a-c61bfae9e009]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:24:38 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:24:38 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:24:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:24:38 user nova-compute[71507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c (non-flash)
Apr 13 15:24:38 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:24:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c0c0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c'): ({'sdd'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Removing single pathed devices sdd {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8532a916-ef87-42d4-bc26-abce659e88c1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30d3572-602d-4a6c-b2ee-57ffe9f235bf]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flushing IO for device /dev/sdd {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a71057-e897-40a4-b838-5bf7b12de7d7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5947905-37b6-40df-9565-65172962fe27]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26564303632623336', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4b3f324e', '/dev/disk/by-id/scsi-1SCST_BIO4b3f324e-ed062b36d985b8e6') {{(pid=81901) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b75924a-4bfa-441e-93e4-a1856ed87b00]: (4, None) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44402ed-2c55-4010-91ad-64d9de36bbb3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2fbf04-e2f7-48e8-add8-d4cfad6bde8b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c, portal: 172.16.0.220,3260]
Apr 13 15:24:38 user nova-compute[71507]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c, portal: 172.16.0.220,3260] successful.
Apr 13 15:24:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a3847f-ce95-4277-be5b-0a4becc7711c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cfbf65-c118-4f51-8417-030e86489ee5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] <== disconnect_volume: return (321ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:24:38 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Deleting instance files /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f_del
Apr 13 15:24:38 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Deletion of /opt/stack/data/nova/instances/c609c1d1-edcf-4b71-abea-5dd95ebcd81f_del complete
Apr 13 15:24:38 user nova-compute[71507]: INFO nova.compute.manager [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 13 15:24:38 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:24:38 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:24:39 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:24:39 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Took 0.47 seconds to deallocate network for instance.
Apr 13 15:24:39 user nova-compute[71507]: DEBUG nova.compute.manager [req-1d64d695-a577-4dc2-8385-5ff0d579cc24 req-6fbf5be6-356f-414b-8a5c-f22eecf68721 service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-deleted-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:24:39 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:24:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:24:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] Acquiring lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:40 user nova-compute[71507]: DEBUG nova.compute.manager [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] No waiting events found dispatching network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:24:40 user nova-compute[71507]: WARNING nova.compute.manager [req-6d963353-ed77-48e0-baad-ec4a979230c1 req-fa9b3a5c-5235-42b0-9119-2c42f7fb92ca service nova] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Received unexpected event network-vif-plugged-92d492eb-f3b6-4481-b492-949cf7eabd1a for instance with vm_state active and task_state deleting.
Apr 13 15:24:40 user nova-compute[71507]: INFO nova.compute.manager [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Took 0.75 seconds to detach 1 volumes for instance.
Apr 13 15:24:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:40 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:24:40 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:24:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:40 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Deleted allocations for instance c609c1d1-edcf-4b71-abea-5dd95ebcd81f
Apr 13 15:24:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60b67c38-f849-41c7-a07b-9bf87a9a6884 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "c609c1d1-edcf-4b71-abea-5dd95ebcd81f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:53 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399478.4652476, c609c1d1-edcf-4b71-abea-5dd95ebcd81f => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:24:53 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] VM Stopped (Lifecycle Event)
Apr 13 15:24:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6d43d2a5-60e8-4106-b991-949cf7b2ec6b None None] [instance: c609c1d1-edcf-4b71-abea-5dd95ebcd81f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:24:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:24:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:24:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:24:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:24:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-changed-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:24:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Refreshing instance network info cache due to event network-changed-1ef64389-9092-411b-a2cf-f0ad923650c5. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:24:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] Acquiring lock "refresh_cache-f093cc8b-83cd-4154-8b4e-a98481e2c42a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:24:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] Acquired lock "refresh_cache-f093cc8b-83cd-4154-8b4e-a98481e2c42a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:24:55 user nova-compute[71507]: DEBUG nova.network.neutron [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Refreshing network info cache for port 1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:24:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Updated VIF entry in instance network info cache for port 1ef64389-9092-411b-a2cf-f0ad923650c5. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:24:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Updating instance_info_cache with network_info: [{"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:24:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-64dbde39-1906-48b8-aff2-d507738d457a req-7dffd018-2277-4b3a-ae4d-73fbec6da663 service nova] Releasing lock "refresh_cache-f093cc8b-83cd-4154-8b4e-a98481e2c42a" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:24:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received event network-changed-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:24:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Refreshing instance network info cache due to event network-changed-2fcc3406-d672-49a1-85b8-5f2ce187b541. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:24:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] Acquiring lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:24:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] Acquired lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:24:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Refreshing network info cache for port 2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'flavor' on Instance uuid 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:57 user nova-compute[71507]: INFO nova.compute.manager [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Attaching volume 8ab95335-13ea-472f-8b96-919fb6f2cc1e to /dev/vdb
Apr 13 15:24:57 user nova-compute[71507]: DEBUG os_brick.utils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db87fcb-90d4-494a-b5b5-0d80de770608]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cf9875-930c-4a45-ac2f-b53bf3043dea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb52b9c-f968-4a95-8282-0dd923bd6b54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d70d01-80d5-4865-8b72-dce5edef3dbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG nova.network.neutron [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updated VIF entry in instance network info cache for port 2fcc3406-d672-49a1-85b8-5f2ce187b541. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG nova.network.neutron [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updating instance_info_cache with network_info: [{"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:24:57 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c16916-01d6-4b41-9e0b-6258270f3f12]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG os_brick.utils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updating existing volume attachment record: b2e904c9-1bb9-4ac7-ae42-d72ba8cd9871 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4ee395df-4907-4444-9bdf-c6b631b1ccbf req-1e090cc2-7a47-4a59-82af-57175dcb674f service nova] Releasing lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG nova.objects.instance [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:24:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:24:57 user nova-compute[71507]: INFO nova.compute.manager [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Attaching volume e5bcc099-e571-44a4-96ed-33e4c3a0bd73 to /dev/vdb
Apr 13 15:24:58 user nova-compute[71507]: DEBUG os_brick.utils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad3764f-6a67-4ccc-8095-57999ba43b3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21e24df-00e5-4d56-84b8-49173cb72be3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5867b8ad-4dcd-4968-8fdb-29ef40f9443d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a80e52-f459-4902-95b0-abe6025a7374]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:24:58 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:24:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d284a1-7345-4481-bc0e-2f01c686b2d5]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG os_brick.utils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Updating existing volume attachment record: af9f47f5-601a-445d-839c-a8bdbc6a377f {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:24:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYswOJVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:25:01 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:01 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:01 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d905c124-b7c8-4c51-b110-9ed8bc108a6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:25:01 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f4f46c-e5b2-448b-a25a-6196a9cc6d56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e] added
Apr 13 15:25:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca8b76-24c9-43f4-abfe-1cc18498f868]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1270ba43-8e70-4075-ba3f-b702ffaa1659]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYswOJVE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYswOJVE" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe5a230-2362-4a1c-84e6-815badef9e1e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xYswOJVE'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[09321506-c0f2-4e21-a33f-d62cd6118a7c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c30c21-a7f5-4f0a-8f78-6d81484332d4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:01 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:01 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27104ca6-8bae-4d7b-8d0b-4cceb88b7e57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e, portal: 172.16.0.220,3260]
Apr 13 15:25:01 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e, portal: 172.16.0.220,3260] successful.
Apr 13 15:25:01 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cc2049-b43f-4991-b806-4efc4907555e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0cddf0-0ce4-4d93-9b95-2b3a1cecf5f6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:02 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:02 user nova-compute[71507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)
Apr 13 15:25:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:02 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:02 user nova-compute[71507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)
Apr 13 15:25:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e1e6df-9ff9-4c7b-a8f4-838fef8afaac]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYswOJVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcWdCqtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:25:02 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26161633639366162', 'path': '/dev/sdd'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161633639366162', 'path': '/dev/sdd'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.733s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:03 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:03 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'flavor' on Instance uuid 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f48aa9-1aee-45c8-9fef-24e089b3f14f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:25:03 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:25:03 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:25:03 user nova-compute[71507]:   <source dev="/dev/sdd"/>
Apr 13 15:25:03 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:25:03 user nova-compute[71507]:   <serial>8ab95335-13ea-472f-8b96-919fb6f2cc1e</serial>
Apr 13 15:25:03 user nova-compute[71507]: </disk>
Apr 13 15:25:03 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f1bad-a99f-4705-93ee-3923e540784e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73] added
Apr 13 15:25:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adc15d0-59b8-49b2-9383-539c13c3382c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[930234fe-26d9-4681-ae27-ad2669fc3a1d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcWdCqtQ {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcWdCqtQ" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c82376-d7d4-4411-9a7b-7461afbe1684]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bcWdCqtQ'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[603bbff3-dec1-4370-b5fc-d7b9d394dc3e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[715ff5f7-ac8a-438d-b37e-b0dd58ea9c9e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)
Apr 13 15:25:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)
Apr 13 15:25:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e891f2f4-b860-4a03-ac1b-50727bbd8b8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73, portal: 172.16.0.220,3260]
Apr 13 15:25:03 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73, portal: 172.16.0.220,3260] successful.
Apr 13 15:25:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0282f9e-8d75-4c60-a5eb-91c7af28215a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dddcfc6-93b4-464f-b49e-349ace8ac4d3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)
Apr 13 15:25:03 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c584f1-20d7-45ae-b522-055767e4f004]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcWdCqtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No VIF found with MAC fa:16:3e:a6:9a:cd, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:25:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5fad1411-8122-4dae-b6b4-5f666d26ea46 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.477s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== connect_volume: return (2051ms) {'type': 'block', 'scsi_wwn': '26562363930363263', 'path': '/dev/sde'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:25:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562363930363263', 'path': '/dev/sde'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:25:04 user nova-compute[71507]: DEBUG nova.objects.instance [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:25:04 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:25:04 user nova-compute[71507]:   <source dev="/dev/sde"/>
Apr 13 15:25:04 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:25:04 user nova-compute[71507]:   <serial>e5bcc099-e571-44a4-96ed-33e4c3a0bd73</serial>
Apr 13 15:25:04 user nova-compute[71507]: </disk>
Apr 13 15:25:04 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:25:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:25:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:25:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No VIF found with MAC fa:16:3e:ed:ba:8d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:25:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bf28077c-fcfd-4fc1-be4e-479a47ad8501 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.998s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:06 user nova-compute[71507]: INFO nova.compute.manager [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Detaching volume 8ab95335-13ea-472f-8b96-919fb6f2cc1e
Apr 13 15:25:06 user nova-compute[71507]: INFO nova.virt.block_device [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Attempting to driver detach volume 8ab95335-13ea-472f-8b96-919fb6f2cc1e from mountpoint /dev/vdb
Apr 13 15:25:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Attempting to detach device vdb from instance 42464137-e247-4191-8ed4-4bbdbe392f95 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:25:06 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:25:06 user nova-compute[71507]:   <source dev="/dev/sdd"/>
Apr 13 15:25:06 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:25:06 user nova-compute[71507]:   <serial>8ab95335-13ea-472f-8b96-919fb6f2cc1e</serial>
Apr 13 15:25:06 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:25:06 user nova-compute[71507]: </disk>
Apr 13 15:25:06 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:25:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Successfully detached device vdb from instance 42464137-e247-4191-8ed4-4bbdbe392f95 from the persistent domain config.
Apr 13 15:25:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42464137-e247-4191-8ed4-4bbdbe392f95 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:25:06 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:25:06 user nova-compute[71507]:   <source dev="/dev/sdd"/>
Apr 13 15:25:06 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:25:06 user nova-compute[71507]:   <serial>8ab95335-13ea-472f-8b96-919fb6f2cc1e</serial>
Apr 13 15:25:06 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:25:06 user nova-compute[71507]: </disk>
Apr 13 15:25:06 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399506.6960566, 42464137-e247-4191-8ed4-4bbdbe392f95 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:25:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Successfully detached device vdb from instance 42464137-e247-4191-8ed4-4bbdbe392f95 from the live domain config.
Apr 13 15:25:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYswOJVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:25:06 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c1a4bb-30db-4b3e-9da9-dbb3386ee199]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:25:06 user nova-compute[71507]: No targets found.
Apr 13 15:25:06 user nova-compute[71507]: iSNS:
Apr 13 15:25:06 user nova-compute[71507]: No targets found.
Apr 13 15:25:06 user nova-compute[71507]: STATIC:
Apr 13 15:25:06 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:25:06 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:06 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:06 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e
Apr 13 15:25:06 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:06 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:06 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f
Apr 13 15:25:06 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:06 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:06 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73
Apr 13 15:25:06 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:06 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:06 user nova-compute[71507]: FIRMWARE:
Apr 13 15:25:06 user nova-compute[71507]: No targets found.
Apr 13 15:25:06 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:25:06 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:25:06 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3775da2b-73e9-4e8f-9596-8643d102bf2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[663daea9-d984-4529-9501-d9798776e467]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:06 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:06 user nova-compute[71507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)
Apr 13 15:25:06 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:06 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:06 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:06 user nova-compute[71507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e (non-flash)
Apr 13 15:25:06 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:06 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab28927370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e'): ({'sdd'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Removing single pathed devices sdd {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19a14c0-e75f-4b86-9bdd-bb10d2729193]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[436286c0-7857-4f44-a4d9-bc812e352b79]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flushing IO for device /dev/sdd {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93beffe-1736-40f2-9d13-0c2aceee8c0e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86a98ce-724d-453d-93db-6a89492bd46a]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14a0295-6aea-4090-9c99-1eb8cc09c8e7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9111e6b3-b2ba-48ec-b134-f81dc7b04da1]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e, portal: 172.16.0.220,3260]
Apr 13 15:25:06 user nova-compute[71507]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e, portal: 172.16.0.220,3260] successful.
Apr 13 15:25:06 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:06 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab95335-13ea-472f-8b96-919fb6f2cc1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b4ea19-6cae-4913-88e6-051557ffbcb9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] <== disconnect_volume: return (297ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:07 user nova-compute[71507]: INFO nova.compute.manager [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Attaching volume edabdca8-0695-4bae-b177-b99c7144961d to /dev/vdc
Apr 13 15:25:07 user nova-compute[71507]: DEBUG os_brick.utils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea5a286-0b9b-44e6-b48c-552f97374614]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8b8253-c135-4c05-843d-0a5e1e8c02a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1595b627-15f4-49bf-846c-3a1c6146dd4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ff858f-ef2d-44e5-b2db-0f7878ca5e6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:25:07 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d995b-ba20-4f28-a60a-2e871cd9e170]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG os_brick.utils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Updating existing volume attachment record: fedb2ff4-d4c5-4f11-8c95-766c05025c5b {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG nova.objects.instance [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'flavor' on Instance uuid 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-48ad46de-c23e-41c7-b857-722423b939dd tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:11 user nova-compute[71507]: INFO nova.compute.manager [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Terminating instance
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-bf063152-ac2a-4152-bd49-3dfcc8978ad5 req-695dc975-e1d5-4906-a2b3-2e3e6273c46f service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-unplugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:25:11 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Instance destroyed successfully.
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'resources' on Instance uuid ccc7b5bd-5f78-448e-bd82-74b2263dff75 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1163510400',display_name='tempest-ServerActionsTestJSON-server-2112327637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1163510400',id=17,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:22:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-drdg1xsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:22:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=ccc7b5bd-5f78-448e-bd82-74b2263dff75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "address": "fa:16:3e:f7:02:ec", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8ad360-aa", "ovs_interfaceid": "9c8ad360-aa62-4ef1-952f-d73f885baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_vif [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c8ad360-aa, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:25:11 user nova-compute[71507]: INFO os_vif [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=9c8ad360-aa62-4ef1-952f-d73f885baa89,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8ad360-aa')
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXpRLefv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:25:11 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba61b2d9-d520-40d1-baa1-9659e7ee9fa3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:25:11 user nova-compute[71507]: No targets found.
Apr 13 15:25:11 user nova-compute[71507]: iSNS:
Apr 13 15:25:11 user nova-compute[71507]: No targets found.
Apr 13 15:25:11 user nova-compute[71507]: STATIC:
Apr 13 15:25:11 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:25:11 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:11 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:11 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f
Apr 13 15:25:11 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:11 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:11 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73
Apr 13 15:25:11 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:11 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:11 user nova-compute[71507]: FIRMWARE:
Apr 13 15:25:11 user nova-compute[71507]: No targets found.
Apr 13 15:25:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:25:11 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:25:11 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZWQtCfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:25:11 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d513c0-bc5e-4a13-b1b8-61027493e685]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b616febc-93fa-47bd-9bfb-30a9e23d06c5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:11 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:11 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:11 user nova-compute[71507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f (non-flash)
Apr 13 15:25:11 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c393010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0211693d-def6-466e-9921-f8be3d15c95b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[627dd3fd-e154-433a-9b69-66f6e3122081]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfcb9bc-c3e8-4b9e-ae62-1baadaabbffe]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1901bf8-22d7-404b-bfe3-53b2489e91cf]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cea431-9dff-4971-bb4c-ff14e9d6a126]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[339d871e-7ad1-44ec-8ed3-cde183600338]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260]
Apr 13 15:25:12 user nova-compute[71507]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f, portal: 172.16.0.220,3260] successful.
Apr 13 15:25:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e2b917-2efe-4a44-8c06-1a70d0c6d09f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[602242de-85ec-409f-b10d-31702e27a43c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== disconnect_volume: return (313ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:25:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Deleting instance files /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75_del
Apr 13 15:25:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Deletion of /opt/stack/data/nova/instances/ccc7b5bd-5f78-448e-bd82-74b2263dff75_del complete
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.290s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:12 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:12 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fc5b50-0608-4e87-bb83-2a52a105d237]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:25:12 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d6ac88-5344-4e76-8ee3-2cc33a3e4e5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d] added
Apr 13 15:25:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: INFO nova.compute.manager [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[948b76c9-a439-4f96-b2e1-8e1c06c0a385]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[859321e9-cf74-4bd5-a20f-3ce1183cedf6]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZWQtCfl {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZWQtCfl" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bb99f4-d0a7-4d9e-931d-5e72a56970ac]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZWQtCfl'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b94ba9-8a9c-45a7-b6a3-eb5f4280debe]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc096d15-3d15-40e3-92ab-5b7a723873f9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:12 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:12 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38ba764-6963-4a30-bb3f-b9636862c0d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d, portal: 172.16.0.220,3260]
Apr 13 15:25:12 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d, portal: 172.16.0.220,3260] successful.
Apr 13 15:25:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e5bf98-11d8-4dcf-89ac-609e3f9a791a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58edbd1-59b2-4395-b4a3-cfc6c20a6e21]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:12 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:12 user nova-compute[71507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d (non-flash)
Apr 13 15:25:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:12 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:12 user nova-compute[71507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d (non-flash)
Apr 13 15:25:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac410f94-f7be-44fc-b9cd-ddcdb3484299]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:25:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZWQtCfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== connect_volume: return (1594ms) {'type': 'block', 'scsi_wwn': '26231643735303532', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231643735303532', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:25:13 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:25:13 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:25:13 user nova-compute[71507]:   <target dev="vdc" bus="virtio"/>
Apr 13 15:25:13 user nova-compute[71507]:   <serial>edabdca8-0695-4bae-b177-b99c7144961d</serial>
Apr 13 15:25:13 user nova-compute[71507]: </disk>
Apr 13 15:25:13 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] Acquiring lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] No waiting events found dispatching network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:13 user nova-compute[71507]: WARNING nova.compute.manager [req-8caa8c6e-fb33-470c-840c-09601e5c0e23 req-52aab2c3-b5b0-4e94-8974-fa910ff280a4 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received unexpected event network-vif-plugged-9c8ad360-aa62-4ef1-952f-d73f885baa89 for instance with vm_state active and task_state deleting.
Apr 13 15:25:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:25:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] No VIF found with MAC fa:16:3e:ed:ba:8d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:25:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7dab8448-13c7-4a02-b805-4123000d7b65 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.673s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:14 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:25:14 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Took 2.01 seconds to deallocate network for instance.
Apr 13 15:25:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-bee92484-690e-42fe-ab5f-2a4c816dc004 req-b005e93b-6121-4072-bf6f-7aa26cd21b10 service nova] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Received event network-vif-deleted-9c8ad360-aa62-4ef1-952f-d73f885baa89 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:15 user nova-compute[71507]: INFO nova.compute.manager [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Took 0.78 seconds to detach 1 volumes for instance.
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:15 user nova-compute[71507]: INFO nova.compute.manager [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Detaching volume e5bcc099-e571-44a4-96ed-33e4c3a0bd73
Apr 13 15:25:15 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:25:15 user nova-compute[71507]: INFO nova.virt.block_device [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Attempting to driver detach volume e5bcc099-e571-44a4-96ed-33e4c3a0bd73 from mountpoint /dev/vdb
Apr 13 15:25:15 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Attempting to detach device vdb from instance f093cc8b-83cd-4154-8b4e-a98481e2c42a from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:25:15 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:25:15 user nova-compute[71507]:   <source dev="/dev/sde"/>
Apr 13 15:25:15 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:25:15 user nova-compute[71507]:   <serial>e5bcc099-e571-44a4-96ed-33e4c3a0bd73</serial>
Apr 13 15:25:15 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:25:15 user nova-compute[71507]: </disk>
Apr 13 15:25:15 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:25:15 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully detached device vdb from instance f093cc8b-83cd-4154-8b4e-a98481e2c42a from the persistent domain config.
Apr 13 15:25:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f093cc8b-83cd-4154-8b4e-a98481e2c42a from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:25:15 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:25:15 user nova-compute[71507]:   <source dev="/dev/sde"/>
Apr 13 15:25:15 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:25:15 user nova-compute[71507]:   <serial>e5bcc099-e571-44a4-96ed-33e4c3a0bd73</serial>
Apr 13 15:25:15 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:25:15 user nova-compute[71507]: </disk>
Apr 13 15:25:15 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:15 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Deleted allocations for instance ccc7b5bd-5f78-448e-bd82-74b2263dff75
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-14456293-8744-4c48-97f6-abd0dcb413c3 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "ccc7b5bd-5f78-448e-bd82-74b2263dff75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.436s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399515.863042, f093cc8b-83cd-4154-8b4e-a98481e2c42a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:25:15 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully detached device vdb from instance f093cc8b-83cd-4154-8b4e-a98481e2c42a from the live domain config.
Apr 13 15:25:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcWdCqtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:25:15 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bab19a7-cc56-4af0-b859-ac7659711cec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:25:15 user nova-compute[71507]: No targets found.
Apr 13 15:25:15 user nova-compute[71507]: iSNS:
Apr 13 15:25:15 user nova-compute[71507]: No targets found.
Apr 13 15:25:15 user nova-compute[71507]: STATIC:
Apr 13 15:25:15 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d
Apr 13 15:25:15 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:15 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:15 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:25:15 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:15 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:15 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73
Apr 13 15:25:15 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:15 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:15 user nova-compute[71507]: FIRMWARE:
Apr 13 15:25:15 user nova-compute[71507]: No targets found.
Apr 13 15:25:15 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:25:15 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:25:15 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c984a800-e93f-47c2-be02-ee2aa4b82c1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f6f2a4-4d13-4c82-8b34-a73d3d2fea58]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:15 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:15 user nova-compute[71507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d (non-flash)
Apr 13 15:25:15 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:15 user nova-compute[71507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 (non-flash)
Apr 13 15:25:15 user nova-compute[71507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d (non-flash)
Apr 13 15:25:15 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab289a29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73'): ({'sde'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Removing single pathed devices sde {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba8238-a612-4736-aa01-8af6c125e0f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[925a3692-5138-4761-9743-8060d77b3cf8]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flushing IO for device /dev/sde {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:25:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4491a3-e786-4685-a798-344944da8a79]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[12df061e-6670-4c26-a106-4362c37469fb]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] SCSI volumes sde have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe0469d-5d48-4b8e-8036-5f1fffec39ae]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec89e0f-bd53-4530-8885-f4f26197f684]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73, portal: 172.16.0.220,3260]
Apr 13 15:25:16 user nova-compute[71507]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73, portal: 172.16.0.220,3260] successful.
Apr 13 15:25:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bcc099-e571-44a4-96ed-33e4c3a0bd73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1d3ca5-69dd-46e7-88ec-e25d3c8a16a5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== disconnect_volume: return (285ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:25:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:17 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ea506302-b251-4b37-81ed-1caa81a133a8 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.823s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:17 user nova-compute[71507]: INFO nova.compute.manager [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Detaching volume edabdca8-0695-4bae-b177-b99c7144961d
Apr 13 15:25:17 user nova-compute[71507]: INFO nova.virt.block_device [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Attempting to driver detach volume edabdca8-0695-4bae-b177-b99c7144961d from mountpoint /dev/vdc
Apr 13 15:25:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Attempting to detach device vdc from instance f093cc8b-83cd-4154-8b4e-a98481e2c42a from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:25:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:25:17 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:25:17 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:25:17 user nova-compute[71507]:   <target dev="vdc" bus="virtio"/>
Apr 13 15:25:17 user nova-compute[71507]:   <serial>edabdca8-0695-4bae-b177-b99c7144961d</serial>
Apr 13 15:25:17 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 15:25:17 user nova-compute[71507]: </disk>
Apr 13 15:25:17 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:25:17 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully detached device vdc from instance f093cc8b-83cd-4154-8b4e-a98481e2c42a from the persistent domain config.
Apr 13 15:25:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f093cc8b-83cd-4154-8b4e-a98481e2c42a from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:25:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:25:17 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:25:17 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:25:17 user nova-compute[71507]:   <target dev="vdc" bus="virtio"/>
Apr 13 15:25:17 user nova-compute[71507]:   <serial>edabdca8-0695-4bae-b177-b99c7144961d</serial>
Apr 13 15:25:17 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 15:25:17 user nova-compute[71507]: </disk>
Apr 13 15:25:17 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399518.2048554, f093cc8b-83cd-4154-8b4e-a98481e2c42a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:25:18 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully detached device vdc from instance f093cc8b-83cd-4154-8b4e-a98481e2c42a from the live domain config.
Apr 13 15:25:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZWQtCfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:25:18 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef14f7df-9a39-406b-839f-c9de285dfa56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:25:18 user nova-compute[71507]: No targets found.
Apr 13 15:25:18 user nova-compute[71507]: iSNS:
Apr 13 15:25:18 user nova-compute[71507]: No targets found.
Apr 13 15:25:18 user nova-compute[71507]: STATIC:
Apr 13 15:25:18 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d
Apr 13 15:25:18 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:18 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:18 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:25:18 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:25:18 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:25:18 user nova-compute[71507]: FIRMWARE:
Apr 13 15:25:18 user nova-compute[71507]: No targets found.
Apr 13 15:25:18 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:25:18 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:25:18 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0987d978-239a-49d3-863b-51fe87939a23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[053b81d8-9ce8-46f2-85a1-205177c37978]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:18 user nova-compute[71507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d (non-flash)
Apr 13 15:25:18 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:25:18 user nova-compute[71507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d (non-flash)
Apr 13 15:25:18 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c147a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccab1f27-1df2-4d6b-9b04-778b0723e73d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0db5eb-106e-4185-b99b-e8013f0e642a]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a576c-f511-44b4-97bd-4575faf0bbc4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db19d4d-f1f0-4a2d-834b-740c584dbc63]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f95ea9-44f4-439f-9e83-e94d7a6703d2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d00b097-d58c-4540-af35-2ca80b95c278]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d, portal: 172.16.0.220,3260]
Apr 13 15:25:18 user nova-compute[71507]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d, portal: 172.16.0.220,3260] successful.
Apr 13 15:25:18 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edabdca8-0695-4bae-b177-b99c7144961d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f852ad23-6f5e-4f51-b849-1176be7330a8]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] <== disconnect_volume: return (282ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:25:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:25:19 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'flavor' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a6d67cb0-ca8a-481d-aece-a740fa101219 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:20 user nova-compute[71507]: INFO nova.compute.manager [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Terminating instance
Apr 13 15:25:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-unplugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] No waiting events found dispatching network-vif-unplugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-ce9b2eb4-5e7b-4c86-b8eb-0efb85e852eb req-a2520e5b-e6d0-4894-ab7c-b7c746b0d3b3 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-unplugged-1ef64389-9092-411b-a2cf-f0ad923650c5 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:25:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Instance destroyed successfully.
Apr 13 15:25:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lazy-loading 'resources' on Instance uuid f093cc8b-83cd-4154-8b4e-a98481e2c42a {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1518437861',display_name='tempest-AttachVolumeTestJSON-server-1518437861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1518437861',id=28,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdTSuvMCCSoO8gEL+Y4LzWCT6AMVJXqlSXautXO8WYI89z5mAhSWOc9+LI3QBpLskYzTiUPYNLmXCHJhNKKLvGDwdUolY7+TdNY3npIh3wlWQQVeSyeE6ZEta6F1YhiDA==',key_name='tempest-keypair-1855443748',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:23:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ceba33821a9b4f7aa81c2857c11261f1',ramdisk_id='',reservation_id='r-ytbuq5ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-157319562',owner_user_name='tempest-AttachVolumeTestJSON-157319562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:23:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de1a698b103a47c0b2864eef54be648b',uuid=f093cc8b-83cd-4154-8b4e-a98481e2c42a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converting VIF {"id": "1ef64389-9092-411b-a2cf-f0ad923650c5", "address": "fa:16:3e:ed:ba:8d", "network": {"id": "9e196c6b-274c-477b-9f83-c526ca47c2a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1249333427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceba33821a9b4f7aa81c2857c11261f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef64389-90", "ovs_interfaceid": "1ef64389-9092-411b-a2cf-f0ad923650c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:ba:8d,bridge_name='br-int',has_traffic_filtering=True,id=1ef64389-9092-411b-a2cf-f0ad923650c5,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef64389-90') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG os_vif [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:ba:8d,bridge_name='br-int',has_traffic_filtering=True,id=1ef64389-9092-411b-a2cf-f0ad923650c5,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef64389-90') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ef64389-90, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: INFO os_vif [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:ba:8d,bridge_name='br-int',has_traffic_filtering=True,id=1ef64389-9092-411b-a2cf-f0ad923650c5,network=Network(9e196c6b-274c-477b-9f83-c526ca47c2a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef64389-90')
Apr 13 15:25:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Deleting instance files /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a_del
Apr 13 15:25:21 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Deletion of /opt/stack/data/nova/instances/f093cc8b-83cd-4154-8b4e-a98481e2c42a_del complete
Apr 13 15:25:21 user nova-compute[71507]: INFO nova.compute.manager [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 15:25:21 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:25:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:25:22 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Took 1.32 seconds to deallocate network for instance.
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updating instance_info_cache with network_info: [{"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-0a0a9548-9e57-4007-bafb-d418a4433473" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-a53da693-8799-43b5-9219-f0dcba8db038 req-9529362f-7c19-486d-9e2e-a1aa219cebbe service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-deleted-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] No waiting events found dispatching network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:22 user nova-compute[71507]: WARNING nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received unexpected event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 for instance with vm_state deleted and task_state None.
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] No waiting events found dispatching network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:22 user nova-compute[71507]: WARNING nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received unexpected event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 for instance with vm_state deleted and task_state None.
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] No waiting events found dispatching network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:22 user nova-compute[71507]: WARNING nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received unexpected event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 for instance with vm_state deleted and task_state None.
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-unplugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] No waiting events found dispatching network-vif-unplugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:22 user nova-compute[71507]: WARNING nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received unexpected event network-vif-unplugged-1ef64389-9092-411b-a2cf-f0ad923650c5 for instance with vm_state deleted and task_state None.
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Acquiring lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] No waiting events found dispatching network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:22 user nova-compute[71507]: WARNING nova.compute.manager [req-82f055a9-6328-48be-b6a0-e83c8e8b7b0e req-56585155-331e-414d-b5c9-3f8346c95e48 service nova] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Received unexpected event network-vif-plugged-1ef64389-9092-411b-a2cf-f0ad923650c5 for instance with vm_state deleted and task_state None.
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:22 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Deleted allocations for instance f093cc8b-83cd-4154-8b4e-a98481e2c42a
Apr 13 15:25:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1bffe4d6-a54d-465c-9d6a-79be068578c2 tempest-AttachVolumeTestJSON-157319562 tempest-AttachVolumeTestJSON-157319562-project-member] Lock "f093cc8b-83cd-4154-8b4e-a98481e2c42a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.608s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:24 user nova-compute[71507]: INFO nova.compute.manager [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Terminating instance
Apr 13 15:25:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received event network-vif-unplugged-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] No waiting events found dispatching network-vif-unplugged-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-aca895f0-8bc2-4c30-b451-4be25cf1a137 req-0c080d83-4b1c-4c71-8264-c4e8dc234cb2 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received event network-vif-unplugged-714a062f-8189-4905-b41f-619554697056 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Instance destroyed successfully.
Apr 13 15:25:24 user nova-compute[71507]: DEBUG nova.objects.instance [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'resources' on Instance uuid 75a68333-dc4d-48d9-84c6-4c7cd515853e {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:22:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-462259660',display_name='tempest-AttachVolumeNegativeTest-server-462259660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-462259660',id=27,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCah+9H+8jh4CmJxEHYVZOlBpAJ3gCxsuGIfaDmRJo2gMuNYJKtf1qSAj9IJYkaI4lz+2Iyyk5h4jh7yZiU15svcNNYGaS/rHTOvo5L88SXHT9jfFzTOEqZvhKmOknO7Vg==',key_name='tempest-keypair-2093832726',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:22:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-4de3fnki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:22:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=75a68333-dc4d-48d9-84c6-4c7cd515853e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "714a062f-8189-4905-b41f-619554697056", "address": "fa:16:3e:1c:a0:3f", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714a062f-81", "ovs_interfaceid": "714a062f-8189-4905-b41f-619554697056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:a0:3f,bridge_name='br-int',has_traffic_filtering=True,id=714a062f-8189-4905-b41f-619554697056,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714a062f-81') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG os_vif [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:a0:3f,bridge_name='br-int',has_traffic_filtering=True,id=714a062f-8189-4905-b41f-619554697056,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714a062f-81') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap714a062f-81, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:25:24 user nova-compute[71507]: INFO os_vif [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:a0:3f,bridge_name='br-int',has_traffic_filtering=True,id=714a062f-8189-4905-b41f-619554697056,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714a062f-81')
Apr 13 15:25:24 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Deleting instance files /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e_del
Apr 13 15:25:24 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Deletion of /opt/stack/data/nova/instances/75a68333-dc4d-48d9-84c6-4c7cd515853e_del complete
Apr 13 15:25:25 user nova-compute[71507]: INFO nova.compute.manager [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 15:25:25 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:25:25 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:25:25 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:25:25 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:25:25 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Took 0.79 seconds to deallocate network for instance.
Apr 13 15:25:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-876e6df4-6215-4c17-af4c-eca16808dbff req-326d92f7-6196-44e0-a7ed-1f12897d0b14 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received event network-vif-deleted-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:26 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Deleted allocations for instance 75a68333-dc4d-48d9-84c6-4c7cd515853e
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-532dc95e-6fe8-48b2-b845-e35859b11f1a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.008s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:25:26 user nova-compute[71507]: INFO nova.compute.claims [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Claim successful on node user
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received event network-vif-plugged-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] Acquiring lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] Lock "75a68333-dc4d-48d9-84c6-4c7cd515853e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] No waiting events found dispatching network-vif-plugged-714a062f-8189-4905-b41f-619554697056 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:26 user nova-compute[71507]: WARNING nova.compute.manager [req-c129186f-dc3f-4595-ae0a-2a6d40062ffc req-1ae0b6cf-d3e2-4c9b-8929-4523c2f80be5 service nova] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Received unexpected event network-vif-plugged-714a062f-8189-4905-b41f-619554697056 for instance with vm_state deleted and task_state None.
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.network.neutron [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:25:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.policy [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:25:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Creating image(s)
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "/opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "/opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "/opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399511.8361592, ccc7b5bd-5f78-448e-bd82-74b2263dff75 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:25:26 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] VM Stopped (Lifecycle Event)
Apr 13 15:25:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-515c2703-f199-4871-baae-5a47d8e65b00 None None] [instance: ccc7b5bd-5f78-448e-bd82-74b2263dff75] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk 1073741824" returned: 0 in 0.047s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG nova.network.neutron [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Successfully created port: 51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Cannot resize image /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG nova.objects.instance [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lazy-loading 'migration_context' on Instance uuid 22bb22bd-efa8-4679-979a-dd0ce28a79e3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Ensure instance console log exists: /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.neutron [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Successfully updated port: 51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquired lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.neutron [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received event network-changed-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Refreshing instance network info cache due to event network-changed-51fbfc5f-6a68-41b6-9153-192b47c76902. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] Acquiring lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.neutron [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "149f8be9-79d3-4922-b3cc-c164b8b81534" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:28 user nova-compute[71507]: INFO nova.compute.manager [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Terminating instance
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.neutron [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Updating instance_info_cache with network_info: [{"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Releasing lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Instance network_info: |[{"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] Acquired lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.neutron [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Refreshing network info cache for port 51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Start _get_guest_xml network_info=[{"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:25:28 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:25:28 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2052126560',display_name='tempest-ServersNegativeTestJSON-server-2052126560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2052126560',id=30,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ac07b9454744832b26bf6bd126763ec',ramdisk_id='',reservation_id='r-7hzhimt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-187650290',owner_user_name='tempest-ServersNegativeTestJSON-187650290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:25:27Z,user_data=None,user_id='3a6955546e4f4292a25acad709d27953',uuid=22bb22bd-efa8-4679-979a-dd0ce28a79e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converting VIF {"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4a:50,bridge_name='br-int',has_traffic_filtering=True,id=51fbfc5f-6a68-41b6-9153-192b47c76902,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fbfc5f-6a') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.objects.instance [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lazy-loading 'pci_devices' on Instance uuid 22bb22bd-efa8-4679-979a-dd0ce28a79e3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:25:28 user nova-compute[71507]:   <uuid>22bb22bd-efa8-4679-979a-dd0ce28a79e3</uuid>
Apr 13 15:25:28 user nova-compute[71507]:   <name>instance-0000001e</name>
Apr 13 15:25:28 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:25:28 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:25:28 user nova-compute[71507]:   <metadata>
Apr 13 15:25:28 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:25:28 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:25:28 user nova-compute[71507]:       <nova:name>tempest-ServersNegativeTestJSON-server-2052126560</nova:name>
Apr 13 15:25:28 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:25:28</nova:creationTime>
Apr 13 15:25:28 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:25:28 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:25:28 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:25:28 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:25:28 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:25:28 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:25:28 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:25:28 user nova-compute[71507]:       <nova:owner>
Apr 13 15:25:28 user nova-compute[71507]:         <nova:user uuid="3a6955546e4f4292a25acad709d27953">tempest-ServersNegativeTestJSON-187650290-project-member</nova:user>
Apr 13 15:25:28 user nova-compute[71507]:         <nova:project uuid="1ac07b9454744832b26bf6bd126763ec">tempest-ServersNegativeTestJSON-187650290</nova:project>
Apr 13 15:25:28 user nova-compute[71507]:       </nova:owner>
Apr 13 15:25:28 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:25:28 user nova-compute[71507]:       <nova:ports>
Apr 13 15:25:28 user nova-compute[71507]:         <nova:port uuid="51fbfc5f-6a68-41b6-9153-192b47c76902">
Apr 13 15:25:28 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 15:25:28 user nova-compute[71507]:         </nova:port>
Apr 13 15:25:28 user nova-compute[71507]:       </nova:ports>
Apr 13 15:25:28 user nova-compute[71507]:     </nova:instance>
Apr 13 15:25:28 user nova-compute[71507]:   </metadata>
Apr 13 15:25:28 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:25:28 user nova-compute[71507]:     <system>
Apr 13 15:25:28 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:25:28 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:25:28 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:25:28 user nova-compute[71507]:       <entry name="serial">22bb22bd-efa8-4679-979a-dd0ce28a79e3</entry>
Apr 13 15:25:28 user nova-compute[71507]:       <entry name="uuid">22bb22bd-efa8-4679-979a-dd0ce28a79e3</entry>
Apr 13 15:25:28 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:25:28 user nova-compute[71507]:     </system>
Apr 13 15:25:28 user nova-compute[71507]:   </sysinfo>
Apr 13 15:25:28 user nova-compute[71507]:   <os>
Apr 13 15:25:28 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:25:28 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:25:28 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:25:28 user nova-compute[71507]:   </os>
Apr 13 15:25:28 user nova-compute[71507]:   <features>
Apr 13 15:25:28 user nova-compute[71507]:     <acpi/>
Apr 13 15:25:28 user nova-compute[71507]:     <apic/>
Apr 13 15:25:28 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:25:28 user nova-compute[71507]:   </features>
Apr 13 15:25:28 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:25:28 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:25:28 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:25:28 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:25:28 user nova-compute[71507]:   </clock>
Apr 13 15:25:28 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:25:28 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:25:28 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:25:28 user nova-compute[71507]:   </cpu>
Apr 13 15:25:28 user nova-compute[71507]:   <devices>
Apr 13 15:25:28 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:25:28 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:25:28 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk"/>
Apr 13 15:25:28 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:25:28 user nova-compute[71507]:     </disk>
Apr 13 15:25:28 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:25:28 user nova-compute[71507]:       <mac address="fa:16:3e:c6:4a:50"/>
Apr 13 15:25:28 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:25:28 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:25:28 user nova-compute[71507]:       <target dev="tap51fbfc5f-6a"/>
Apr 13 15:25:28 user nova-compute[71507]:     </interface>
Apr 13 15:25:28 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:25:28 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/console.log" append="off"/>
Apr 13 15:25:28 user nova-compute[71507]:     </serial>
Apr 13 15:25:28 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:25:28 user nova-compute[71507]:     <video>
Apr 13 15:25:28 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:25:28 user nova-compute[71507]:     </video>
Apr 13 15:25:28 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:25:28 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:25:28 user nova-compute[71507]:     </rng>
Apr 13 15:25:28 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:25:28 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:25:28 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:25:28 user nova-compute[71507]:     </memballoon>
Apr 13 15:25:28 user nova-compute[71507]:   </devices>
Apr 13 15:25:28 user nova-compute[71507]: </domain>
Apr 13 15:25:28 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2052126560',display_name='tempest-ServersNegativeTestJSON-server-2052126560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2052126560',id=30,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ac07b9454744832b26bf6bd126763ec',ramdisk_id='',reservation_id='r-7hzhimt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-187650290',owner_user_name='tempest-ServersNegativeTestJSON-187650290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:25:27Z,user_data=None,user_id='3a6955546e4f4292a25acad709d27953',uuid=22bb22bd-efa8-4679-979a-dd0ce28a79e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converting VIF {"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4a:50,bridge_name='br-int',has_traffic_filtering=True,id=51fbfc5f-6a68-41b6-9153-192b47c76902,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fbfc5f-6a') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG os_vif [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4a:50,bridge_name='br-int',has_traffic_filtering=True,id=51fbfc5f-6a68-41b6-9153-192b47c76902,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fbfc5f-6a') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51fbfc5f-6a, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51fbfc5f-6a, col_values=(('external_ids', {'iface-id': '51fbfc5f-6a68-41b6-9153-192b47c76902', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:4a:50', 'vm-uuid': '22bb22bd-efa8-4679-979a-dd0ce28a79e3'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:28 user nova-compute[71507]: INFO os_vif [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4a:50,bridge_name='br-int',has_traffic_filtering=True,id=51fbfc5f-6a68-41b6-9153-192b47c76902,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fbfc5f-6a')
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received event network-vif-unplugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] Acquiring lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] No waiting events found dispatching network-vif-unplugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-580de49c-0e16-405c-b03a-50535f41d491 req-93d9d914-b3e3-431e-84f2-1b575b0c6a33 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received event network-vif-unplugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] No VIF found with MAC fa:16:3e:c6:4a:50, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.neutron [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Updated VIF entry in instance network info cache for port 51fbfc5f-6a68-41b6-9153-192b47c76902. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG nova.network.neutron [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Updating instance_info_cache with network_info: [{"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:25:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-76d84853-4a09-4211-ad40-56fd9567a07a req-e083b406-a391-4d15-b471-9def8cd11a7d service nova] Releasing lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:25:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Instance destroyed successfully.
Apr 13 15:25:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'resources' on Instance uuid 149f8be9-79d3-4922-b3cc-c164b8b81534 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-604430842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-604430842',id=23,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-ub1aq1gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:18:04Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=149f8be9-79d3-4922-b3cc-c164b8b81534,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "address": "fa:16:3e:5d:89:5e", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67be9d84-c4", "ovs_interfaceid": "67be9d84-c425-4bd9-8b9e-6ea31add6ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=67be9d84-c425-4bd9-8b9e-6ea31add6ccf,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67be9d84-c4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG os_vif [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=67be9d84-c425-4bd9-8b9e-6ea31add6ccf,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67be9d84-c4') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67be9d84-c4, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:29 user nova-compute[71507]: INFO os_vif [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=67be9d84-c425-4bd9-8b9e-6ea31add6ccf,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67be9d84-c4')
Apr 13 15:25:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Deleting instance files /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534_del
Apr 13 15:25:29 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Deletion of /opt/stack/data/nova/instances/149f8be9-79d3-4922-b3cc-c164b8b81534_del complete
Apr 13 15:25:29 user nova-compute[71507]: INFO nova.compute.manager [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Took 1.31 seconds to destroy the instance on the hypervisor.
Apr 13 15:25:29 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:25:29 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:25:30 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Took 0.50 seconds to deallocate network for instance.
Apr 13 15:25:30 user nova-compute[71507]: DEBUG nova.compute.manager [req-750b2723-1b5a-4c78-bc80-bf3b80f32a76 req-168747c1-380f-4c3c-a35f-368cb630b5a5 service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received event network-vif-deleted-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:25:30 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Deleted allocations for instance 149f8be9-79d3-4922-b3cc-c164b8b81534
Apr 13 15:25:30 user nova-compute[71507]: DEBUG nova.compute.manager [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received event network-vif-plugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] Acquiring lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG nova.compute.manager [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] No waiting events found dispatching network-vif-plugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:30 user nova-compute[71507]: WARNING nova.compute.manager [req-a1904906-f34e-457d-be48-f93541b103d6 req-b57db58c-3b24-4ee2-a34e-950af419c04f service nova] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Received unexpected event network-vif-plugged-67be9d84-c425-4bd9-8b9e-6ea31add6ccf for instance with vm_state deleted and task_state None.
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-bd60df2a-c65a-49fb-92e5-48269237ebab tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "149f8be9-79d3-4922-b3cc-c164b8b81534" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.441s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:25:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received event network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Acquiring lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] No waiting events found dispatching network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:32 user nova-compute[71507]: WARNING nova.compute.manager [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received unexpected event network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 for instance with vm_state building and task_state spawning.
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received event network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Acquiring lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] No waiting events found dispatching network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:25:32 user nova-compute[71507]: WARNING nova.compute.manager [req-c1f11554-7c13-41c3-931a-7931ff6f9c16 req-17ee1c2a-25b3-4c9e-a84a-f008feab60db service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received unexpected event network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 for instance with vm_state building and task_state spawning.
Apr 13 15:25:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:25:32 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8354MB free_disk=26.19601058959961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 0a0a9548-9e57-4007-bafb-d418a4433473 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 42464137-e247-4191-8ed4-4bbdbe392f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399532.5958655, 22bb22bd-efa8-4679-979a-dd0ce28a79e3 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:25:32 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] VM Resumed (Lifecycle Event)
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:25:32 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Instance spawned successfully.
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:25:32 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399532.5987978, 22bb22bd-efa8-4679-979a-dd0ce28a79e3 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:25:32 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] VM Started (Lifecycle Event)
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:25:32 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:25:32 user nova-compute[71507]: INFO nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Took 5.95 seconds to spawn the instance on the hypervisor.
Apr 13 15:25:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:25:32 user nova-compute[71507]: INFO nova.compute.manager [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Took 6.54 seconds to build instance.
Apr 13 15:25:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1cb8316d-fd36-4b9a-8e1f-8c628a316fd5 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.643s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:25:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:25:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:36 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399521.07825, f093cc8b-83cd-4154-8b4e-a98481e2c42a => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:25:36 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] VM Stopped (Lifecycle Event)
Apr 13 15:25:36 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cf0efe5b-9232-486c-994f-c99829b58fcc None None] [instance: f093cc8b-83cd-4154-8b4e-a98481e2c42a] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:25:36 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:39 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399524.9160438, 75a68333-dc4d-48d9-84c6-4c7cd515853e => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:25:39 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] VM Stopped (Lifecycle Event)
Apr 13 15:25:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-0f0cab3c-1945-48e2-af58-188e6ff628a1 None None] [instance: 75a68333-dc4d-48d9-84c6-4c7cd515853e] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:25:40 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:25:44 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399529.5432243, 149f8be9-79d3-4922-b3cc-c164b8b81534 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:25:44 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] VM Stopped (Lifecycle Event)
Apr 13 15:25:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2a7c409c-0ad8-4f28-bf86-7ddd5a0227cf None None] [instance: 149f8be9-79d3-4922-b3cc-c164b8b81534] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:25:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:25:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:25:59 user nova-compute[71507]: INFO nova.compute.manager [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] instance snapshotting
Apr 13 15:25:59 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Beginning live snapshot process
Apr 13 15:25:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json -f qcow2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json -f qcow2 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json -f qcow2" returned: 0 in 0.155s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.128s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpau6xecbs/dd190d728b73484f85ee2e492de29e01.delta 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpau6xecbs/dd190d728b73484f85ee2e492de29e01.delta 1073741824" returned: 0 in 0.046s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 15:26:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:26:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 15:26:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 15:26:01 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:26:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpau6xecbs/dd190d728b73484f85ee2e492de29e01.delta /opt/stack/data/nova/instances/snapshots/tmpau6xecbs/dd190d728b73484f85ee2e492de29e01 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpau6xecbs/dd190d728b73484f85ee2e492de29e01.delta /opt/stack/data/nova/instances/snapshots/tmpau6xecbs/dd190d728b73484f85ee2e492de29e01" returned: 0 in 0.289s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Snapshot extracted, beginning image upload
Apr 13 15:26:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:02 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:26:03 user nova-compute[71507]: INFO nova.compute.claims [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Claim successful on node user
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:26:03 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.policy [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:26:03 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Creating image(s)
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "/opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "/opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "/opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.203s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk 1073741824" returned: 0 in 0.048s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:04 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Snapshot image upload complete
Apr 13 15:26:04 user nova-compute[71507]: INFO nova.compute.manager [None req-9775719e-c319-4658-bb47-df083c3e237d tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Took 4.36 seconds to snapshot the instance on the hypervisor.
Apr 13 15:26:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Cannot resize image /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'migration_context' on Instance uuid 58e8e652-d56c-45b6-92ff-a50406ea48e9 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Successfully created port: 018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Ensure instance console log exists: /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Successfully updated port: 018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-changed-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.compute.manager [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Refreshing instance network info cache due to event network-changed-018bebd6-4323-4f9d-8c6d-6da9a7934a97. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] Acquiring lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updating instance_info_cache with network_info: [{"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Instance network_info: |[{"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] Acquired lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.network.neutron [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Refreshing network info cache for port 018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Start _get_guest_xml network_info=[{"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:26:05 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:05 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-635850251',display_name='tempest-ServerActionsTestJSON-server-635850251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-635850251',id=31,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-lgh5ks3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=58e8e652-d56c-45b6-92ff-a50406ea48e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:ea,bridge_name='br-int',has_traffic_filtering=True,id=018bebd6-4323-4f9d-8c6d-6da9a7934a97,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018bebd6-43') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'pci_devices' on Instance uuid 58e8e652-d56c-45b6-92ff-a50406ea48e9 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:26:05 user nova-compute[71507]:   <uuid>58e8e652-d56c-45b6-92ff-a50406ea48e9</uuid>
Apr 13 15:26:05 user nova-compute[71507]:   <name>instance-0000001f</name>
Apr 13 15:26:05 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:26:05 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:26:05 user nova-compute[71507]:   <metadata>
Apr 13 15:26:05 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:26:05 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:26:05 user nova-compute[71507]:       <nova:name>tempest-ServerActionsTestJSON-server-635850251</nova:name>
Apr 13 15:26:05 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:26:05</nova:creationTime>
Apr 13 15:26:05 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:26:05 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:26:05 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:26:05 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:26:05 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:26:05 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:26:05 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:26:05 user nova-compute[71507]:       <nova:owner>
Apr 13 15:26:05 user nova-compute[71507]:         <nova:user uuid="3c12c62d4137473596571e523163e718">tempest-ServerActionsTestJSON-423674903-project-member</nova:user>
Apr 13 15:26:05 user nova-compute[71507]:         <nova:project uuid="9154e4239a1a42a3820c27563ba0513f">tempest-ServerActionsTestJSON-423674903</nova:project>
Apr 13 15:26:05 user nova-compute[71507]:       </nova:owner>
Apr 13 15:26:05 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:26:05 user nova-compute[71507]:       <nova:ports>
Apr 13 15:26:05 user nova-compute[71507]:         <nova:port uuid="018bebd6-4323-4f9d-8c6d-6da9a7934a97">
Apr 13 15:26:05 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:26:05 user nova-compute[71507]:         </nova:port>
Apr 13 15:26:05 user nova-compute[71507]:       </nova:ports>
Apr 13 15:26:05 user nova-compute[71507]:     </nova:instance>
Apr 13 15:26:05 user nova-compute[71507]:   </metadata>
Apr 13 15:26:05 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:26:05 user nova-compute[71507]:     <system>
Apr 13 15:26:05 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:26:05 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:26:05 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:26:05 user nova-compute[71507]:       <entry name="serial">58e8e652-d56c-45b6-92ff-a50406ea48e9</entry>
Apr 13 15:26:05 user nova-compute[71507]:       <entry name="uuid">58e8e652-d56c-45b6-92ff-a50406ea48e9</entry>
Apr 13 15:26:05 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:26:05 user nova-compute[71507]:     </system>
Apr 13 15:26:05 user nova-compute[71507]:   </sysinfo>
Apr 13 15:26:05 user nova-compute[71507]:   <os>
Apr 13 15:26:05 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:26:05 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:26:05 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:26:05 user nova-compute[71507]:   </os>
Apr 13 15:26:05 user nova-compute[71507]:   <features>
Apr 13 15:26:05 user nova-compute[71507]:     <acpi/>
Apr 13 15:26:05 user nova-compute[71507]:     <apic/>
Apr 13 15:26:05 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:26:05 user nova-compute[71507]:   </features>
Apr 13 15:26:05 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:26:05 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:26:05 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:26:05 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:26:05 user nova-compute[71507]:   </clock>
Apr 13 15:26:05 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:26:05 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:26:05 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:26:05 user nova-compute[71507]:   </cpu>
Apr 13 15:26:05 user nova-compute[71507]:   <devices>
Apr 13 15:26:05 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:26:05 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:26:05 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk"/>
Apr 13 15:26:05 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:26:05 user nova-compute[71507]:     </disk>
Apr 13 15:26:05 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:26:05 user nova-compute[71507]:       <mac address="fa:16:3e:9b:31:ea"/>
Apr 13 15:26:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:26:05 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:26:05 user nova-compute[71507]:       <target dev="tap018bebd6-43"/>
Apr 13 15:26:05 user nova-compute[71507]:     </interface>
Apr 13 15:26:05 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:26:05 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/console.log" append="off"/>
Apr 13 15:26:05 user nova-compute[71507]:     </serial>
Apr 13 15:26:05 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:26:05 user nova-compute[71507]:     <video>
Apr 13 15:26:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:26:05 user nova-compute[71507]:     </video>
Apr 13 15:26:05 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:26:05 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:26:05 user nova-compute[71507]:     </rng>
Apr 13 15:26:05 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:26:05 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:26:05 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:26:05 user nova-compute[71507]:     </memballoon>
Apr 13 15:26:05 user nova-compute[71507]:   </devices>
Apr 13 15:26:05 user nova-compute[71507]: </domain>
Apr 13 15:26:05 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-635850251',display_name='tempest-ServerActionsTestJSON-server-635850251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-635850251',id=31,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-lgh5ks3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=58e8e652-d56c-45b6-92ff-a50406ea48e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:ea,bridge_name='br-int',has_traffic_filtering=True,id=018bebd6-4323-4f9d-8c6d-6da9a7934a97,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018bebd6-43') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG os_vif [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:ea,bridge_name='br-int',has_traffic_filtering=True,id=018bebd6-4323-4f9d-8c6d-6da9a7934a97,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018bebd6-43') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap018bebd6-43, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap018bebd6-43, col_values=(('external_ids', {'iface-id': '018bebd6-4323-4f9d-8c6d-6da9a7934a97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:31:ea', 'vm-uuid': '58e8e652-d56c-45b6-92ff-a50406ea48e9'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:05 user nova-compute[71507]: INFO os_vif [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:ea,bridge_name='br-int',has_traffic_filtering=True,id=018bebd6-4323-4f9d-8c6d-6da9a7934a97,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018bebd6-43')
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:26:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No VIF found with MAC fa:16:3e:9b:31:ea, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:26:06 user nova-compute[71507]: DEBUG nova.network.neutron [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updated VIF entry in instance network info cache for port 018bebd6-4323-4f9d-8c6d-6da9a7934a97. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:26:06 user nova-compute[71507]: DEBUG nova.network.neutron [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updating instance_info_cache with network_info: [{"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:26:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-eee1424a-ac20-4c33-833d-8c004cddd6de req-542572ce-0f0f-41e0-a0c1-1997352a6793 service nova] Releasing lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] No waiting events found dispatching network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:07 user nova-compute[71507]: WARNING nova.compute.manager [req-ece9f088-71d0-4440-987c-3d6224972b0d req-c45c33fa-7839-404f-917e-46684f46a9a4 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received unexpected event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance with vm_state building and task_state spawning.
Apr 13 15:26:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:26:08 user nova-compute[71507]: INFO nova.compute.claims [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Claim successful on node user
Apr 13 15:26:08 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:26:08 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:26:08 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:26:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.policy [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78e289648c244c77ab9ca48154da3cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318b9e0eb6a745df811d1daa4d6195fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:26:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Creating image(s)
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "/opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "/opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "144ac4559a95d46294b43255c5e57220fa4e30ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "144ac4559a95d46294b43255c5e57220fa4e30ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Successfully created port: f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399569.307761, 58e8e652-d56c-45b6-92ff-a50406ea48e9 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:26:09 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] VM Resumed (Lifecycle Event)
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] No waiting events found dispatching network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:09 user nova-compute[71507]: WARNING nova.compute.manager [req-f146fd45-0163-475e-99c9-097ae065ce47 req-b4038129-85de-4d7d-b526-42a2de8d6629 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received unexpected event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance with vm_state building and task_state spawning.
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Instance spawned successfully.
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:26:09 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399569.3092062, 58e8e652-d56c-45b6-92ff-a50406ea48e9 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:26:09 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] VM Started (Lifecycle Event)
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.virt.images [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] d01d37a3-eaac-4176-9a21-d48e499cdde1 was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:26:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca.part /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:10 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:26:10 user nova-compute[71507]: INFO nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Took 6.54 seconds to spawn the instance on the hypervisor.
Apr 13 15:26:10 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:10 user nova-compute[71507]: INFO nova.compute.manager [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Took 7.15 seconds to build instance.
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ab86cab9-25c0-412e-bd43-1a06ee6e0737 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.394s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca.part /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca.converted" returned: 0 in 0.363s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "144ac4559a95d46294b43255c5e57220fa4e30ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.400s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "144ac4559a95d46294b43255c5e57220fa4e30ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "144ac4559a95d46294b43255c5e57220fa4e30ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Successfully updated port: f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquired lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca --force-share --output=json" returned: 0 in 0.160s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca,backing_fmt=raw /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca,backing_fmt=raw /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk 1073741824" returned: 0 in 0.054s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "144ac4559a95d46294b43255c5e57220fa4e30ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca --force-share --output=json" returned: 0 in 0.150s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'migration_context' on Instance uuid ed13cfeb-933e-4cff-804a-f7404df7f2b0 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Ensure instance console log exists: /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.network.neutron [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Updating instance_info_cache with network_info: [{"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Releasing lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Instance network_info: |[{"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Start _get_guest_xml network_info=[{"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='60da67d95664ba170e633561bd753828',container_format='bare',created_at=2023-04-13T15:25:59Z,direct_url=<?>,disk_format='qcow2',id=d01d37a3-eaac-4176-9a21-d48e499cdde1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1884066718',owner='318b9e0eb6a745df811d1daa4d6195fc',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T15:26:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': 'd01d37a3-eaac-4176-9a21-d48e499cdde1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:26:11 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:11 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='60da67d95664ba170e633561bd753828',container_format='bare',created_at=2023-04-13T15:25:59Z,direct_url=<?>,disk_format='qcow2',id=d01d37a3-eaac-4176-9a21-d48e499cdde1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1884066718',owner='318b9e0eb6a745df811d1daa4d6195fc',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T15:26:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1014644686',display_name='tempest-TestStampPattern-server-1014644686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1014644686',id=32,image_ref='d01d37a3-eaac-4176-9a21-d48e499cdde1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAksZCequnPeyEoxbRX4FTqaIZECithWpaNGXiycVZEBPtiDQC3OzUbnYo2ImPDa8dvWI39XTOjrHTgd99yZNpia3NMbHa+IllMmi0NURtQ7qbFcLr5JTdfFUpnNv2P7uA==',key_name='tempest-TestStampPattern-1982719940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318b9e0eb6a745df811d1daa4d6195fc',ramdisk_id='',reservation_id='r-q38nc5mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='42464137-e247-4191-8ed4-4bbdbe392f95',image_min_disk='1',image_min_ram='0',image_owner_id='318b9e0eb6a745df811d1daa4d6195fc',image_owner_project_name='tempest-TestStampPattern-1572934421',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1572934421-project-member',image_user_id='78e289648c244c77ab9ca48154da3cde',network_allocated='True',owner_project_name='tempest-TestStampPattern-1572934421',owner_user_name='tempest-TestStampPattern-1572934421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:26:09Z,user_data=None,user_id='78e289648c244c77ab9ca48154da3cde',uuid=ed13cfeb-933e-4cff-804a-f7404df7f2b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converting VIF {"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a9:90,bridge_name='br-int',has_traffic_filtering=True,id=f72dcc71-6349-4489-8605-18cb581b5750,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf72dcc71-63') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'pci_devices' on Instance uuid ed13cfeb-933e-4cff-804a-f7404df7f2b0 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:26:11 user nova-compute[71507]:   <uuid>ed13cfeb-933e-4cff-804a-f7404df7f2b0</uuid>
Apr 13 15:26:11 user nova-compute[71507]:   <name>instance-00000020</name>
Apr 13 15:26:11 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:26:11 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:26:11 user nova-compute[71507]:   <metadata>
Apr 13 15:26:11 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:26:11 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:26:11 user nova-compute[71507]:       <nova:name>tempest-TestStampPattern-server-1014644686</nova:name>
Apr 13 15:26:11 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:26:11</nova:creationTime>
Apr 13 15:26:11 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:26:11 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:26:11 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:26:11 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:26:11 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:26:11 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:26:11 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:26:11 user nova-compute[71507]:       <nova:owner>
Apr 13 15:26:11 user nova-compute[71507]:         <nova:user uuid="78e289648c244c77ab9ca48154da3cde">tempest-TestStampPattern-1572934421-project-member</nova:user>
Apr 13 15:26:11 user nova-compute[71507]:         <nova:project uuid="318b9e0eb6a745df811d1daa4d6195fc">tempest-TestStampPattern-1572934421</nova:project>
Apr 13 15:26:11 user nova-compute[71507]:       </nova:owner>
Apr 13 15:26:11 user nova-compute[71507]:       <nova:root type="image" uuid="d01d37a3-eaac-4176-9a21-d48e499cdde1"/>
Apr 13 15:26:11 user nova-compute[71507]:       <nova:ports>
Apr 13 15:26:11 user nova-compute[71507]:         <nova:port uuid="f72dcc71-6349-4489-8605-18cb581b5750">
Apr 13 15:26:11 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 15:26:11 user nova-compute[71507]:         </nova:port>
Apr 13 15:26:11 user nova-compute[71507]:       </nova:ports>
Apr 13 15:26:11 user nova-compute[71507]:     </nova:instance>
Apr 13 15:26:11 user nova-compute[71507]:   </metadata>
Apr 13 15:26:11 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:26:11 user nova-compute[71507]:     <system>
Apr 13 15:26:11 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:26:11 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:26:11 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:26:11 user nova-compute[71507]:       <entry name="serial">ed13cfeb-933e-4cff-804a-f7404df7f2b0</entry>
Apr 13 15:26:11 user nova-compute[71507]:       <entry name="uuid">ed13cfeb-933e-4cff-804a-f7404df7f2b0</entry>
Apr 13 15:26:11 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:26:11 user nova-compute[71507]:     </system>
Apr 13 15:26:11 user nova-compute[71507]:   </sysinfo>
Apr 13 15:26:11 user nova-compute[71507]:   <os>
Apr 13 15:26:11 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:26:11 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:26:11 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:26:11 user nova-compute[71507]:   </os>
Apr 13 15:26:11 user nova-compute[71507]:   <features>
Apr 13 15:26:11 user nova-compute[71507]:     <acpi/>
Apr 13 15:26:11 user nova-compute[71507]:     <apic/>
Apr 13 15:26:11 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:26:11 user nova-compute[71507]:   </features>
Apr 13 15:26:11 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:26:11 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:26:11 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:26:11 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:26:11 user nova-compute[71507]:   </clock>
Apr 13 15:26:11 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:26:11 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:26:11 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:26:11 user nova-compute[71507]:   </cpu>
Apr 13 15:26:11 user nova-compute[71507]:   <devices>
Apr 13 15:26:11 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:26:11 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:26:11 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk"/>
Apr 13 15:26:11 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:26:11 user nova-compute[71507]:     </disk>
Apr 13 15:26:11 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:26:11 user nova-compute[71507]:       <mac address="fa:16:3e:f9:a9:90"/>
Apr 13 15:26:11 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:26:11 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:26:11 user nova-compute[71507]:       <target dev="tapf72dcc71-63"/>
Apr 13 15:26:11 user nova-compute[71507]:     </interface>
Apr 13 15:26:11 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:26:11 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/console.log" append="off"/>
Apr 13 15:26:11 user nova-compute[71507]:     </serial>
Apr 13 15:26:11 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:26:11 user nova-compute[71507]:     <video>
Apr 13 15:26:11 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:26:11 user nova-compute[71507]:     </video>
Apr 13 15:26:11 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:26:11 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:26:11 user nova-compute[71507]:     </rng>
Apr 13 15:26:11 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:26:11 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:26:11 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:26:11 user nova-compute[71507]:     </memballoon>
Apr 13 15:26:11 user nova-compute[71507]:   </devices>
Apr 13 15:26:11 user nova-compute[71507]: </domain>
Apr 13 15:26:11 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1014644686',display_name='tempest-TestStampPattern-server-1014644686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1014644686',id=32,image_ref='d01d37a3-eaac-4176-9a21-d48e499cdde1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAksZCequnPeyEoxbRX4FTqaIZECithWpaNGXiycVZEBPtiDQC3OzUbnYo2ImPDa8dvWI39XTOjrHTgd99yZNpia3NMbHa+IllMmi0NURtQ7qbFcLr5JTdfFUpnNv2P7uA==',key_name='tempest-TestStampPattern-1982719940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='318b9e0eb6a745df811d1daa4d6195fc',ramdisk_id='',reservation_id='r-q38nc5mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='42464137-e247-4191-8ed4-4bbdbe392f95',image_min_disk='1',image_min_ram='0',image_owner_id='318b9e0eb6a745df811d1daa4d6195fc',image_owner_project_name='tempest-TestStampPattern-1572934421',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1572934421-project-member',image_user_id='78e289648c244c77ab9ca48154da3cde',network_allocated='True',owner_project_name='tempest-TestStampPattern-1572934421',owner_user_name='tempest-TestStampPattern-1572934421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:26:09Z,user_data=None,user_id='78e289648c244c77ab9ca48154da3cde',uuid=ed13cfeb-933e-4cff-804a-f7404df7f2b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converting VIF {"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a9:90,bridge_name='br-int',has_traffic_filtering=True,id=f72dcc71-6349-4489-8605-18cb581b5750,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf72dcc71-63') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG os_vif [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a9:90,bridge_name='br-int',has_traffic_filtering=True,id=f72dcc71-6349-4489-8605-18cb581b5750,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf72dcc71-63') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf72dcc71-63, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf72dcc71-63, col_values=(('external_ids', {'iface-id': 'f72dcc71-6349-4489-8605-18cb581b5750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:a9:90', 'vm-uuid': 'ed13cfeb-933e-4cff-804a-f7404df7f2b0'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:11 user nova-compute[71507]: INFO os_vif [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a9:90,bridge_name='br-int',has_traffic_filtering=True,id=f72dcc71-6349-4489-8605-18cb581b5750,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf72dcc71-63')
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No VIF found with MAC fa:16:3e:f9:a9:90, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received event network-changed-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Refreshing instance network info cache due to event network-changed-f72dcc71-6349-4489-8605-18cb581b5750. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] Acquiring lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] Acquired lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Refreshing network info cache for port f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Updated VIF entry in instance network info cache for port f72dcc71-6349-4489-8605-18cb581b5750. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Updating instance_info_cache with network_info: [{"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:26:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5c27b38e-04d1-4bdd-b299-7f9b99af7f4e req-69712e62-6951-48a8-9124-8529b562d55a service nova] Releasing lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:26:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received event network-vif-plugged-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] No waiting events found dispatching network-vif-plugged-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:12 user nova-compute[71507]: WARNING nova.compute.manager [req-a65880e8-28d0-4a15-9d5b-157a3b7cac38 req-e3db0c04-55a1-478e-a631-ec8a910cd0de service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received unexpected event network-vif-plugged-f72dcc71-6349-4489-8605-18cb581b5750 for instance with vm_state building and task_state spawning.
Apr 13 15:26:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:14 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399574.98293, ed13cfeb-933e-4cff-804a-f7404df7f2b0 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:26:14 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] VM Resumed (Lifecycle Event)
Apr 13 15:26:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:26:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:26:14 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Instance spawned successfully.
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received event network-vif-plugged-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] No waiting events found dispatching network-vif-plugged-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:15 user nova-compute[71507]: WARNING nova.compute.manager [req-1aaa5bae-a63d-4b17-8080-8e43d0a05407 req-d4ba29ec-0389-452f-b9e2-fd4f0d952806 service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received unexpected event network-vif-plugged-f72dcc71-6349-4489-8605-18cb581b5750 for instance with vm_state building and task_state spawning.
Apr 13 15:26:15 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399574.9863594, ed13cfeb-933e-4cff-804a-f7404df7f2b0 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:26:15 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] VM Started (Lifecycle Event)
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:26:15 user nova-compute[71507]: INFO nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Took 5.99 seconds to spawn the instance on the hypervisor.
Apr 13 15:26:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:15 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:26:15 user nova-compute[71507]: INFO nova.compute.manager [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Took 6.73 seconds to build instance.
Apr 13 15:26:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee86-a8ac-4e9c-b5ee-06b882654f0c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.819s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:18 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:26:19 user nova-compute[71507]: INFO nova.compute.claims [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Claim successful on node user
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "0a0a9548-9e57-4007-bafb-d418a4433473" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:19 user nova-compute[71507]: INFO nova.compute.manager [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Terminating instance
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-unplugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-unplugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad905396-cfcf-4b32-9e1b-f139cd267f23 req-ef164112-3d61-4ba2-80e2-369da246458a service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-unplugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:26:19 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:26:19 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Creating image(s)
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "/opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "/opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:19 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Instance destroyed successfully.
Apr 13 15:26:19 user nova-compute[71507]: DEBUG nova.objects.instance [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'resources' on Instance uuid 0a0a9548-9e57-4007-bafb-d418a4433473 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.159s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-370949425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-370949425',id=13,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:12:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-khfgpjah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:14:21Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=0a0a9548-9e57-4007-bafb-d418a4433473,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "address": "fa:16:3e:37:e4:e9", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acacba1-f2", "ovs_interfaceid": "0acacba1-f2ca-42c6-9ccb-bb3606bf706e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=0acacba1-f2ca-42c6-9ccb-bb3606bf706e,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acacba1-f2') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_vif [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=0acacba1-f2ca-42c6-9ccb-bb3606bf706e,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acacba1-f2') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0acacba1-f2, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.policy [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fedd34ccc15c47f9a4fc96b080730acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3ba2d132c445039d0ae30ffd2bc64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:26:20 user nova-compute[71507]: INFO os_vif [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:e4:e9,bridge_name='br-int',has_traffic_filtering=True,id=0acacba1-f2ca-42c6-9ccb-bb3606bf706e,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acacba1-f2')
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEauhSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:26:20 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df451fd-64e3-4aa1-ad4c-a61ebf736dd8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:26:20 user nova-compute[71507]: No targets found.
Apr 13 15:26:20 user nova-compute[71507]: iSNS:
Apr 13 15:26:20 user nova-compute[71507]: No targets found.
Apr 13 15:26:20 user nova-compute[71507]: STATIC:
Apr 13 15:26:20 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450
Apr 13 15:26:20 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:26:20 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:26:20 user nova-compute[71507]: FIRMWARE:
Apr 13 15:26:20 user nova-compute[71507]: No targets found.
Apr 13 15:26:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:26:20 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:26:20 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e798260-0930-4088-884c-e32ff7bcf3f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc59eab-9206-4e2d-ab1d-8eddecc06f03]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:26:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 (non-flash)
Apr 13 15:26:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c0c1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk 1073741824" returned: 0 in 0.053s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fa0ddf-854b-4784-89fc-3f90d209f6cf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb0b6c-9813-4565-b16c-68e013b0f256]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[19247b6d-d694-4aa6-a5c4-f7e214798ce6]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b430d770-83e2-4f11-bbaf-671bdf42d250]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f705cf-2ab9-4149-9646-75ae2c049afd]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27278b85-53dd-4a5c-828d-6e586925b76c]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450, portal: 172.16.0.220,3260]
Apr 13 15:26:20 user nova-compute[71507]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450, portal: 172.16.0.220,3260] successful.
Apr 13 15:26:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c479ed5-b804-485c-a64f-90d780d66450 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Cannot resize image /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'migration_context' on Instance uuid e1dcf028-0a0b-4b9d-b654-40f7627ebd36 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b553bb0b-5237-4566-8bda-cefb6b94e003]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] <== disconnect_volume: return (396ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:26:20 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Deleting instance files /opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473_del
Apr 13 15:26:20 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Deletion of /opt/stack/data/nova/instances/0a0a9548-9e57-4007-bafb-d418a4433473_del complete
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Ensure instance console log exists: /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:20 user nova-compute[71507]: INFO nova.compute.manager [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Took 1.40 seconds to destroy the instance on the hypervisor.
Apr 13 15:26:20 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:26:20 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Successfully created port: 4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:26:21 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Took 0.57 seconds to deallocate network for instance.
Apr 13 15:26:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-3d42bf6d-6e0e-42e8-91fb-9601d493b3cb req-d9984ccc-75a1-45dd-a7a6-4344e82f9442 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-deleted-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] Acquiring lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] Lock "0a0a9548-9e57-4007-bafb-d418a4433473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] No waiting events found dispatching network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:21 user nova-compute[71507]: WARNING nova.compute.manager [req-5ee76525-0502-4af2-ad49-435a6e119506 req-bb667d55-67fe-4f4c-a99a-a6cb174d2ae3 service nova] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Received unexpected event network-vif-plugged-0acacba1-f2ca-42c6-9ccb-bb3606bf706e for instance with vm_state active and task_state deleting.
Apr 13 15:26:21 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Successfully updated port: 4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "refresh_cache-e1dcf028-0a0b-4b9d-b654-40f7627ebd36" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquired lock "refresh_cache-e1dcf028-0a0b-4b9d-b654-40f7627ebd36" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:26:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:26:21 user nova-compute[71507]: INFO nova.compute.manager [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Took 0.84 seconds to detach 1 volumes for instance.
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Updating instance_info_cache with network_info: [{"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Releasing lock "refresh_cache-e1dcf028-0a0b-4b9d-b654-40f7627ebd36" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Instance network_info: |[{"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Start _get_guest_xml network_info=[{"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:26:22 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:22 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-478534840',display_name='tempest-AttachVolumeNegativeTest-server-478534840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-478534840',id=33,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBeFSuWghn2ppx3LV4kwZSZ9u3eFqKrqHzSj6nztIlK6sepsmjvLDfGRp5YpOTa3ynO1wxxPjRYQuPWi1qCH33zqkCZqjkRoS2IFUvCmStWVu+wnE1oyDC/D062bqzoaw==',key_name='tempest-keypair-99368010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-h2we3v82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=e1dcf028-0a0b-4b9d-b654-40f7627ebd36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:16:13,bridge_name='br-int',has_traffic_filtering=True,id=4c0cf892-f8a1-4d12-b359-b2673ecfd984,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0cf892-f8') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'pci_devices' on Instance uuid e1dcf028-0a0b-4b9d-b654-40f7627ebd36 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:26:22 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Deleted allocations for instance 0a0a9548-9e57-4007-bafb-d418a4433473
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:26:22 user nova-compute[71507]:   <uuid>e1dcf028-0a0b-4b9d-b654-40f7627ebd36</uuid>
Apr 13 15:26:22 user nova-compute[71507]:   <name>instance-00000021</name>
Apr 13 15:26:22 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:26:22 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:26:22 user nova-compute[71507]:   <metadata>
Apr 13 15:26:22 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:26:22 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:26:22 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeNegativeTest-server-478534840</nova:name>
Apr 13 15:26:22 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:26:22</nova:creationTime>
Apr 13 15:26:22 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:26:22 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:26:22 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:26:22 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:26:22 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:26:22 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:26:22 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:26:22 user nova-compute[71507]:       <nova:owner>
Apr 13 15:26:22 user nova-compute[71507]:         <nova:user uuid="fedd34ccc15c47f9a4fc96b080730acd">tempest-AttachVolumeNegativeTest-416139458-project-member</nova:user>
Apr 13 15:26:22 user nova-compute[71507]:         <nova:project uuid="3e3ba2d132c445039d0ae30ffd2bc64a">tempest-AttachVolumeNegativeTest-416139458</nova:project>
Apr 13 15:26:22 user nova-compute[71507]:       </nova:owner>
Apr 13 15:26:22 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:26:22 user nova-compute[71507]:       <nova:ports>
Apr 13 15:26:22 user nova-compute[71507]:         <nova:port uuid="4c0cf892-f8a1-4d12-b359-b2673ecfd984">
Apr 13 15:26:22 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 15:26:22 user nova-compute[71507]:         </nova:port>
Apr 13 15:26:22 user nova-compute[71507]:       </nova:ports>
Apr 13 15:26:22 user nova-compute[71507]:     </nova:instance>
Apr 13 15:26:22 user nova-compute[71507]:   </metadata>
Apr 13 15:26:22 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:26:22 user nova-compute[71507]:     <system>
Apr 13 15:26:22 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:26:22 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:26:22 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:26:22 user nova-compute[71507]:       <entry name="serial">e1dcf028-0a0b-4b9d-b654-40f7627ebd36</entry>
Apr 13 15:26:22 user nova-compute[71507]:       <entry name="uuid">e1dcf028-0a0b-4b9d-b654-40f7627ebd36</entry>
Apr 13 15:26:22 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:26:22 user nova-compute[71507]:     </system>
Apr 13 15:26:22 user nova-compute[71507]:   </sysinfo>
Apr 13 15:26:22 user nova-compute[71507]:   <os>
Apr 13 15:26:22 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:26:22 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:26:22 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:26:22 user nova-compute[71507]:   </os>
Apr 13 15:26:22 user nova-compute[71507]:   <features>
Apr 13 15:26:22 user nova-compute[71507]:     <acpi/>
Apr 13 15:26:22 user nova-compute[71507]:     <apic/>
Apr 13 15:26:22 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:26:22 user nova-compute[71507]:   </features>
Apr 13 15:26:22 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:26:22 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:26:22 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:26:22 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:26:22 user nova-compute[71507]:   </clock>
Apr 13 15:26:22 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:26:22 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:26:22 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:26:22 user nova-compute[71507]:   </cpu>
Apr 13 15:26:22 user nova-compute[71507]:   <devices>
Apr 13 15:26:22 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:26:22 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:26:22 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk"/>
Apr 13 15:26:22 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:26:22 user nova-compute[71507]:     </disk>
Apr 13 15:26:22 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:26:22 user nova-compute[71507]:       <mac address="fa:16:3e:23:16:13"/>
Apr 13 15:26:22 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:26:22 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:26:22 user nova-compute[71507]:       <target dev="tap4c0cf892-f8"/>
Apr 13 15:26:22 user nova-compute[71507]:     </interface>
Apr 13 15:26:22 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:26:22 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/console.log" append="off"/>
Apr 13 15:26:22 user nova-compute[71507]:     </serial>
Apr 13 15:26:22 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:26:22 user nova-compute[71507]:     <video>
Apr 13 15:26:22 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:26:22 user nova-compute[71507]:     </video>
Apr 13 15:26:22 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:26:22 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:26:22 user nova-compute[71507]:     </rng>
Apr 13 15:26:22 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:26:22 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:26:22 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:26:22 user nova-compute[71507]:     </memballoon>
Apr 13 15:26:22 user nova-compute[71507]:   </devices>
Apr 13 15:26:22 user nova-compute[71507]: </domain>
Apr 13 15:26:22 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-478534840',display_name='tempest-AttachVolumeNegativeTest-server-478534840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-478534840',id=33,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBeFSuWghn2ppx3LV4kwZSZ9u3eFqKrqHzSj6nztIlK6sepsmjvLDfGRp5YpOTa3ynO1wxxPjRYQuPWi1qCH33zqkCZqjkRoS2IFUvCmStWVu+wnE1oyDC/D062bqzoaw==',key_name='tempest-keypair-99368010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-h2we3v82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=e1dcf028-0a0b-4b9d-b654-40f7627ebd36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:16:13,bridge_name='br-int',has_traffic_filtering=True,id=4c0cf892-f8a1-4d12-b359-b2673ecfd984,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0cf892-f8') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG os_vif [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:16:13,bridge_name='br-int',has_traffic_filtering=True,id=4c0cf892-f8a1-4d12-b359-b2673ecfd984,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0cf892-f8') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c0cf892-f8, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c0cf892-f8, col_values=(('external_ids', {'iface-id': '4c0cf892-f8a1-4d12-b359-b2673ecfd984', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:16:13', 'vm-uuid': 'e1dcf028-0a0b-4b9d-b654-40f7627ebd36'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:22 user nova-compute[71507]: INFO os_vif [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:16:13,bridge_name='br-int',has_traffic_filtering=True,id=4c0cf892-f8a1-4d12-b359-b2673ecfd984,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0cf892-f8')
Apr 13 15:26:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-15f52b23-d2cf-46bf-83fa-e210d69925c1 tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "0a0a9548-9e57-4007-bafb-d418a4433473" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.395s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:26:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No VIF found with MAC fa:16:3e:23:16:13, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:26:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received event network-changed-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Refreshing instance network info cache due to event network-changed-4c0cf892-f8a1-4d12-b359-b2673ecfd984. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:26:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] Acquiring lock "refresh_cache-e1dcf028-0a0b-4b9d-b654-40f7627ebd36" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:26:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] Acquired lock "refresh_cache-e1dcf028-0a0b-4b9d-b654-40f7627ebd36" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:26:23 user nova-compute[71507]: DEBUG nova.network.neutron [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Refreshing network info cache for port 4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:26:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received event network-vif-plugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] No waiting events found dispatching network-vif-plugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:24 user nova-compute[71507]: WARNING nova.compute.manager [req-76b171ef-039e-42eb-8bb5-b6be32106ca9 req-ab5cd529-6774-41fb-9355-2e7938e917cc service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received unexpected event network-vif-plugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance with vm_state building and task_state spawning.
Apr 13 15:26:24 user nova-compute[71507]: DEBUG nova.network.neutron [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Updated VIF entry in instance network info cache for port 4c0cf892-f8a1-4d12-b359-b2673ecfd984. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG nova.network.neutron [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Updating instance_info_cache with network_info: [{"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-74642e5b-57f2-4507-9562-663a19e4b06f req-f18e45e8-323b-4793-b0e8-1afd59541a02 service nova] Releasing lock "refresh_cache-e1dcf028-0a0b-4b9d-b654-40f7627ebd36" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399586.0891013, e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:26:26 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] VM Resumed (Lifecycle Event)
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:26:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Instance spawned successfully.
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:26 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399586.0925841, e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:26:26 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] VM Started (Lifecycle Event)
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:26:26 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received event network-vif-plugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] No waiting events found dispatching network-vif-plugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:26 user nova-compute[71507]: WARNING nova.compute.manager [req-b05567b1-4bdf-45b5-a605-f86922d24ca6 req-033b4b20-b2ac-4b48-8605-cb130447b560 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received unexpected event network-vif-plugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance with vm_state building and task_state spawning.
Apr 13 15:26:26 user nova-compute[71507]: INFO nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Took 6.44 seconds to spawn the instance on the hypervisor.
Apr 13 15:26:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:26 user nova-compute[71507]: INFO nova.compute.manager [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Took 7.37 seconds to build instance.
Apr 13 15:26:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ef6cf928-cbf0-4cc6-a78e-32c37211a416 tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.487s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399579.9513102, 0a0a9548-9e57-4007-bafb-d418a4433473 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:26:35 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] VM Stopped (Lifecycle Event)
Apr 13 15:26:35 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:35 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8000MB free_disk=26.04446029663086GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e9010dd1-8c35-47ff-94da-ee9f7a4a5f24 None None] [instance: 0a0a9548-9e57-4007-bafb-d418a4433473] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 42464137-e247-4191-8ed4-4bbdbe392f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:26:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:36 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:26:36 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:26:36 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:26:36 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:26:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:37 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:26:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:26:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:26:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:26:50 user nova-compute[71507]: INFO nova.compute.claims [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Claim successful on node user
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:26:50 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.policy [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd5e19b47fa493395ca0432e6d85251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21b26110ef24c259a7f45913f46d6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:26:50 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Creating image(s)
Apr 13 15:26:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "/opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "/opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk 1073741824" returned: 0 in 0.055s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Successfully created port: be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Cannot resize image /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lazy-loading 'migration_context' on Instance uuid 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Ensure instance console log exists: /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Successfully updated port: be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "refresh_cache-2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquired lock "refresh_cache-2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received event network-changed-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Refreshing instance network info cache due to event network-changed-be7faa0d-9682-48e3-9a50-db4d80d7a54a. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] Acquiring lock "refresh_cache-2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Updating instance_info_cache with network_info: [{"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Releasing lock "refresh_cache-2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Instance network_info: |[{"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] Acquired lock "refresh_cache-2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.network.neutron [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Refreshing network info cache for port be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Start _get_guest_xml network_info=[{"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:26:52 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:52 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-539053316',display_name='tempest-VolumesActionsTest-instance-539053316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-539053316',id=34,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c21b26110ef24c259a7f45913f46d6af',ramdisk_id='',reservation_id='r-a5iqdn8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1866117776',owner_user_name='tempest-VolumesActionsTest-1866117776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:26:51Z,user_data=None,user_id='6fd5e19b47fa493395ca0432e6d85251',uuid=2dba94be-8cb8-477e-aa7f-0239b9cdc4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Converting VIF {"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:7d:6b,bridge_name='br-int',has_traffic_filtering=True,id=be7faa0d-9682-48e3-9a50-db4d80d7a54a,network=Network(83cf3a37-c06c-4968-b7be-db5b44d56301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7faa0d-96') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:26:52 user nova-compute[71507]:   <uuid>2dba94be-8cb8-477e-aa7f-0239b9cdc4a1</uuid>
Apr 13 15:26:52 user nova-compute[71507]:   <name>instance-00000022</name>
Apr 13 15:26:52 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:26:52 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:26:52 user nova-compute[71507]:   <metadata>
Apr 13 15:26:52 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:26:52 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:26:52 user nova-compute[71507]:       <nova:name>tempest-VolumesActionsTest-instance-539053316</nova:name>
Apr 13 15:26:52 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:26:52</nova:creationTime>
Apr 13 15:26:52 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:26:52 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:26:52 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:26:52 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:26:52 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:26:52 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:26:52 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:26:52 user nova-compute[71507]:       <nova:owner>
Apr 13 15:26:52 user nova-compute[71507]:         <nova:user uuid="6fd5e19b47fa493395ca0432e6d85251">tempest-VolumesActionsTest-1866117776-project-member</nova:user>
Apr 13 15:26:52 user nova-compute[71507]:         <nova:project uuid="c21b26110ef24c259a7f45913f46d6af">tempest-VolumesActionsTest-1866117776</nova:project>
Apr 13 15:26:52 user nova-compute[71507]:       </nova:owner>
Apr 13 15:26:52 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:26:52 user nova-compute[71507]:       <nova:ports>
Apr 13 15:26:52 user nova-compute[71507]:         <nova:port uuid="be7faa0d-9682-48e3-9a50-db4d80d7a54a">
Apr 13 15:26:52 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 15:26:52 user nova-compute[71507]:         </nova:port>
Apr 13 15:26:52 user nova-compute[71507]:       </nova:ports>
Apr 13 15:26:52 user nova-compute[71507]:     </nova:instance>
Apr 13 15:26:52 user nova-compute[71507]:   </metadata>
Apr 13 15:26:52 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:26:52 user nova-compute[71507]:     <system>
Apr 13 15:26:52 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:26:52 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:26:52 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:26:52 user nova-compute[71507]:       <entry name="serial">2dba94be-8cb8-477e-aa7f-0239b9cdc4a1</entry>
Apr 13 15:26:52 user nova-compute[71507]:       <entry name="uuid">2dba94be-8cb8-477e-aa7f-0239b9cdc4a1</entry>
Apr 13 15:26:52 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:26:52 user nova-compute[71507]:     </system>
Apr 13 15:26:52 user nova-compute[71507]:   </sysinfo>
Apr 13 15:26:52 user nova-compute[71507]:   <os>
Apr 13 15:26:52 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:26:52 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:26:52 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:26:52 user nova-compute[71507]:   </os>
Apr 13 15:26:52 user nova-compute[71507]:   <features>
Apr 13 15:26:52 user nova-compute[71507]:     <acpi/>
Apr 13 15:26:52 user nova-compute[71507]:     <apic/>
Apr 13 15:26:52 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:26:52 user nova-compute[71507]:   </features>
Apr 13 15:26:52 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:26:52 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:26:52 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:26:52 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:26:52 user nova-compute[71507]:   </clock>
Apr 13 15:26:52 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:26:52 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:26:52 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:26:52 user nova-compute[71507]:   </cpu>
Apr 13 15:26:52 user nova-compute[71507]:   <devices>
Apr 13 15:26:52 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:26:52 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:26:52 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk"/>
Apr 13 15:26:52 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:26:52 user nova-compute[71507]:     </disk>
Apr 13 15:26:52 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:26:52 user nova-compute[71507]:       <mac address="fa:16:3e:25:7d:6b"/>
Apr 13 15:26:52 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:26:52 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:26:52 user nova-compute[71507]:       <target dev="tapbe7faa0d-96"/>
Apr 13 15:26:52 user nova-compute[71507]:     </interface>
Apr 13 15:26:52 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:26:52 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/console.log" append="off"/>
Apr 13 15:26:52 user nova-compute[71507]:     </serial>
Apr 13 15:26:52 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:26:52 user nova-compute[71507]:     <video>
Apr 13 15:26:52 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:26:52 user nova-compute[71507]:     </video>
Apr 13 15:26:52 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:26:52 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:26:52 user nova-compute[71507]:     </rng>
Apr 13 15:26:52 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:26:52 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:26:52 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:26:52 user nova-compute[71507]:     </memballoon>
Apr 13 15:26:52 user nova-compute[71507]:   </devices>
Apr 13 15:26:52 user nova-compute[71507]: </domain>
Apr 13 15:26:52 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-539053316',display_name='tempest-VolumesActionsTest-instance-539053316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-539053316',id=34,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c21b26110ef24c259a7f45913f46d6af',ramdisk_id='',reservation_id='r-a5iqdn8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1866117776',owner_user_name='tempest-VolumesActionsTest-1866117776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:26:51Z,user_data=None,user_id='6fd5e19b47fa493395ca0432e6d85251',uuid=2dba94be-8cb8-477e-aa7f-0239b9cdc4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Converting VIF {"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:7d:6b,bridge_name='br-int',has_traffic_filtering=True,id=be7faa0d-9682-48e3-9a50-db4d80d7a54a,network=Network(83cf3a37-c06c-4968-b7be-db5b44d56301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7faa0d-96') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG os_vif [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:7d:6b,bridge_name='br-int',has_traffic_filtering=True,id=be7faa0d-9682-48e3-9a50-db4d80d7a54a,network=Network(83cf3a37-c06c-4968-b7be-db5b44d56301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7faa0d-96') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe7faa0d-96, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe7faa0d-96, col_values=(('external_ids', {'iface-id': 'be7faa0d-9682-48e3-9a50-db4d80d7a54a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:7d:6b', 'vm-uuid': '2dba94be-8cb8-477e-aa7f-0239b9cdc4a1'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:52 user nova-compute[71507]: INFO os_vif [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:7d:6b,bridge_name='br-int',has_traffic_filtering=True,id=be7faa0d-9682-48e3-9a50-db4d80d7a54a,network=Network(83cf3a37-c06c-4968-b7be-db5b44d56301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7faa0d-96')
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:26:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] No VIF found with MAC fa:16:3e:25:7d:6b, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:26:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Updated VIF entry in instance network info cache for port be7faa0d-9682-48e3-9a50-db4d80d7a54a. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:26:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Updating instance_info_cache with network_info: [{"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:26:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c3082b83-9213-43ee-abfd-0da01c19b09f req-d3345aea-5ca9-4535-9b4a-882e97759038 service nova] Releasing lock "refresh_cache-2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:26:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received event network-vif-plugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] Acquiring lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] No waiting events found dispatching network-vif-plugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:54 user nova-compute[71507]: WARNING nova.compute.manager [req-13daa239-6623-4b7b-a1a1-5964d23a1f86 req-9a455d2c-f585-4907-a89a-59226b0077bb service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received unexpected event network-vif-plugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance with vm_state building and task_state spawning.
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399616.3582156, 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:26:56 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] VM Resumed (Lifecycle Event)
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:26:56 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Instance spawned successfully.
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:26:56 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399616.360072, 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:26:56 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] VM Started (Lifecycle Event)
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:26:56 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:26:56 user nova-compute[71507]: INFO nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Took 5.49 seconds to spawn the instance on the hypervisor.
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:26:56 user nova-compute[71507]: INFO nova.compute.manager [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Took 6.10 seconds to build instance.
Apr 13 15:26:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9af4f17f-0fc4-4068-81b8-070478edfc2c tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.193s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received event network-vif-plugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] Acquiring lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:26:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] No waiting events found dispatching network-vif-plugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:26:56 user nova-compute[71507]: WARNING nova.compute.manager [req-0b4533e9-eb04-4da6-889e-1c12d6841964 req-f1f68b09-9c3c-4eba-8a08-60da105a86a0 service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received unexpected event network-vif-plugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance with vm_state active and task_state None.
Apr 13 15:26:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:26:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:27:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:27:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:27:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:27:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:27:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:09 user nova-compute[71507]: INFO nova.compute.manager [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Terminating instance
Apr 13 15:27:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:27:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received event network-vif-unplugged-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] Acquiring lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] No waiting events found dispatching network-vif-unplugged-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-b0068bbc-ffa0-4f10-a627-34e6153676ce req-c9c81f29-58f1-4673-944f-ecf31341d7a0 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received event network-vif-unplugged-e2b989b1-9194-48e5-a3e4-e35566440e3d for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:27:10 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Instance destroyed successfully.
Apr 13 15:27:10 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lazy-loading 'resources' on Instance uuid 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-464267024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-464267024',id=4,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:07:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='240b28f42732478ba732994b2c9e3fbe',ramdisk_id='',reservation_id='r-fxa6n0q3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:09:31Z,user_data=None,user_id='75bf6e19993f4c2e90fd52c4d6212622',uuid=37ff2115-ebfa-4cd2-b52f-89e354f0f5ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converting VIF {"id": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "address": "fa:16:3e:9a:65:54", "network": {"id": "928c080b-0ead-4f65-85b3-2c98a7549dbb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1899814691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "240b28f42732478ba732994b2c9e3fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b989b1-91", "ovs_interfaceid": "e2b989b1-9194-48e5-a3e4-e35566440e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:65:54,bridge_name='br-int',has_traffic_filtering=True,id=e2b989b1-9194-48e5-a3e4-e35566440e3d,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b989b1-91') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG os_vif [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:65:54,bridge_name='br-int',has_traffic_filtering=True,id=e2b989b1-9194-48e5-a3e4-e35566440e3d,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b989b1-91') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2b989b1-91, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:27:10 user nova-compute[71507]: INFO os_vif [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:65:54,bridge_name='br-int',has_traffic_filtering=True,id=e2b989b1-9194-48e5-a3e4-e35566440e3d,network=Network(928c080b-0ead-4f65-85b3-2c98a7549dbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b989b1-91')
Apr 13 15:27:10 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Deleting instance files /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba_del
Apr 13 15:27:10 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Deletion of /opt/stack/data/nova/instances/37ff2115-ebfa-4cd2-b52f-89e354f0f5ba_del complete
Apr 13 15:27:10 user nova-compute[71507]: INFO nova.compute.manager [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 13 15:27:10 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:27:10 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:27:11 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:27:11 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Took 0.47 seconds to deallocate network for instance.
Apr 13 15:27:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received event network-vif-deleted-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:27:11 user nova-compute[71507]: INFO nova.compute.manager [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Neutron deleted interface e2b989b1-9194-48e5-a3e4-e35566440e3d; detaching it from the instance and deleting it from the info cache
Apr 13 15:27:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:27:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-fdd1bb84-b7b0-4913-b319-ead7689d7b16 req-e39b9a93-6c8c-4090-ae18-a6811c5c5309 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Detach interface failed, port_id=e2b989b1-9194-48e5-a3e4-e35566440e3d, reason: Instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:27:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:11 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:27:11 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:27:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:11 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Deleted allocations for instance 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba
Apr 13 15:27:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c7afb447-3cac-43a8-a136-b52ed14e11ba tempest-ServerBootFromVolumeStableRescueTest-1009244781 tempest-ServerBootFromVolumeStableRescueTest-1009244781-project-member] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.543s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received event network-vif-plugged-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:27:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] Acquiring lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] Lock "37ff2115-ebfa-4cd2-b52f-89e354f0f5ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] No waiting events found dispatching network-vif-plugged-e2b989b1-9194-48e5-a3e4-e35566440e3d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:27:12 user nova-compute[71507]: WARNING nova.compute.manager [req-3f99e2d8-b809-481c-ada9-dce5b7227c43 req-d63182e1-fdeb-41a1-800d-81a974ee7637 service nova] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Received unexpected event network-vif-plugged-e2b989b1-9194-48e5-a3e4-e35566440e3d for instance with vm_state deleted and task_state None.
Apr 13 15:27:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:27:17 user nova-compute[71507]: INFO nova.compute.claims [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Claim successful on node user
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:27:17 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.policy [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a6955546e4f4292a25acad709d27953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac07b9454744832b26bf6bd126763ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:27:17 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Creating image(s)
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "/opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "/opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.129s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk 1073741824" returned: 0 in 0.049s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:17 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Cannot resize image /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG nova.objects.instance [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lazy-loading 'migration_context' on Instance uuid 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Ensure instance console log exists: /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:18 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Successfully created port: d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Successfully updated port: d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "refresh_cache-8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquired lock "refresh_cache-8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.compute.manager [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received event network-changed-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.compute.manager [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Refreshing instance network info cache due to event network-changed-d8276bf9-698e-4940-bace-2aee0c73f7d8. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] Acquiring lock "refresh_cache-8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Updating instance_info_cache with network_info: [{"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Releasing lock "refresh_cache-8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Instance network_info: |[{"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] Acquired lock "refresh_cache-8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.network.neutron [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Refreshing network info cache for port d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Start _get_guest_xml network_info=[{"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:27:19 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:27:19 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:27:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-504850890',display_name='tempest-ServersNegativeTestJSON-server-504850890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-504850890',id=35,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ac07b9454744832b26bf6bd126763ec',ramdisk_id='',reservation_id='r-a0vf85md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-187650290',owner_user_name='tempest-ServersNegativeTestJSON-187650290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:27:18Z,user_data=None,user_id='3a6955546e4f4292a25acad709d27953',uuid=8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converting VIF {"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=d8276bf9-698e-4940-bace-2aee0c73f7d8,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8276bf9-69') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.objects.instance [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:27:19 user nova-compute[71507]:   <uuid>8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b</uuid>
Apr 13 15:27:19 user nova-compute[71507]:   <name>instance-00000023</name>
Apr 13 15:27:19 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:27:19 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:27:19 user nova-compute[71507]:   <metadata>
Apr 13 15:27:19 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:27:19 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:27:19 user nova-compute[71507]:       <nova:name>tempest-ServersNegativeTestJSON-server-504850890</nova:name>
Apr 13 15:27:19 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:27:19</nova:creationTime>
Apr 13 15:27:19 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:27:19 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:27:19 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:27:19 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:27:19 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:27:19 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:27:19 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:27:19 user nova-compute[71507]:       <nova:owner>
Apr 13 15:27:19 user nova-compute[71507]:         <nova:user uuid="3a6955546e4f4292a25acad709d27953">tempest-ServersNegativeTestJSON-187650290-project-member</nova:user>
Apr 13 15:27:19 user nova-compute[71507]:         <nova:project uuid="1ac07b9454744832b26bf6bd126763ec">tempest-ServersNegativeTestJSON-187650290</nova:project>
Apr 13 15:27:19 user nova-compute[71507]:       </nova:owner>
Apr 13 15:27:19 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:27:19 user nova-compute[71507]:       <nova:ports>
Apr 13 15:27:19 user nova-compute[71507]:         <nova:port uuid="d8276bf9-698e-4940-bace-2aee0c73f7d8">
Apr 13 15:27:19 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 15:27:19 user nova-compute[71507]:         </nova:port>
Apr 13 15:27:19 user nova-compute[71507]:       </nova:ports>
Apr 13 15:27:19 user nova-compute[71507]:     </nova:instance>
Apr 13 15:27:19 user nova-compute[71507]:   </metadata>
Apr 13 15:27:19 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:27:19 user nova-compute[71507]:     <system>
Apr 13 15:27:19 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:27:19 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:27:19 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:27:19 user nova-compute[71507]:       <entry name="serial">8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b</entry>
Apr 13 15:27:19 user nova-compute[71507]:       <entry name="uuid">8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b</entry>
Apr 13 15:27:19 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:27:19 user nova-compute[71507]:     </system>
Apr 13 15:27:19 user nova-compute[71507]:   </sysinfo>
Apr 13 15:27:19 user nova-compute[71507]:   <os>
Apr 13 15:27:19 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:27:19 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:27:19 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:27:19 user nova-compute[71507]:   </os>
Apr 13 15:27:19 user nova-compute[71507]:   <features>
Apr 13 15:27:19 user nova-compute[71507]:     <acpi/>
Apr 13 15:27:19 user nova-compute[71507]:     <apic/>
Apr 13 15:27:19 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:27:19 user nova-compute[71507]:   </features>
Apr 13 15:27:19 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:27:19 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:27:19 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:27:19 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:27:19 user nova-compute[71507]:   </clock>
Apr 13 15:27:19 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:27:19 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:27:19 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:27:19 user nova-compute[71507]:   </cpu>
Apr 13 15:27:19 user nova-compute[71507]:   <devices>
Apr 13 15:27:19 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:27:19 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:27:19 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk"/>
Apr 13 15:27:19 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:27:19 user nova-compute[71507]:     </disk>
Apr 13 15:27:19 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:27:19 user nova-compute[71507]:       <mac address="fa:16:3e:16:ec:8b"/>
Apr 13 15:27:19 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:27:19 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:27:19 user nova-compute[71507]:       <target dev="tapd8276bf9-69"/>
Apr 13 15:27:19 user nova-compute[71507]:     </interface>
Apr 13 15:27:19 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:27:19 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/console.log" append="off"/>
Apr 13 15:27:19 user nova-compute[71507]:     </serial>
Apr 13 15:27:19 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:27:19 user nova-compute[71507]:     <video>
Apr 13 15:27:19 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:27:19 user nova-compute[71507]:     </video>
Apr 13 15:27:19 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:27:19 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:27:19 user nova-compute[71507]:     </rng>
Apr 13 15:27:19 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:27:19 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:27:19 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:27:19 user nova-compute[71507]:     </memballoon>
Apr 13 15:27:19 user nova-compute[71507]:   </devices>
Apr 13 15:27:19 user nova-compute[71507]: </domain>
Apr 13 15:27:19 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:27:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-504850890',display_name='tempest-ServersNegativeTestJSON-server-504850890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-504850890',id=35,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ac07b9454744832b26bf6bd126763ec',ramdisk_id='',reservation_id='r-a0vf85md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-187650290',owner_user_name='tempest-ServersNegativeTestJSON-187650290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:27:18Z,user_data=None,user_id='3a6955546e4f4292a25acad709d27953',uuid=8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converting VIF {"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=d8276bf9-698e-4940-bace-2aee0c73f7d8,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8276bf9-69') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG os_vif [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=d8276bf9-698e-4940-bace-2aee0c73f7d8,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8276bf9-69') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8276bf9-69, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8276bf9-69, col_values=(('external_ids', {'iface-id': 'd8276bf9-698e-4940-bace-2aee0c73f7d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:ec:8b', 'vm-uuid': '8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:19 user nova-compute[71507]: INFO os_vif [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=d8276bf9-698e-4940-bace-2aee0c73f7d8,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8276bf9-69')
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:27:19 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] No VIF found with MAC fa:16:3e:16:ec:8b, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:27:20 user nova-compute[71507]: DEBUG nova.network.neutron [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Updated VIF entry in instance network info cache for port d8276bf9-698e-4940-bace-2aee0c73f7d8. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:27:20 user nova-compute[71507]: DEBUG nova.network.neutron [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Updating instance_info_cache with network_info: [{"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:27:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d92b66cd-182a-44b1-b229-9dd929e81502 req-5e79c735-5652-4c6d-a1df-518e14f3f29d service nova] Releasing lock "refresh_cache-8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:27:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received event network-vif-plugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:27:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] Acquiring lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:21 user nova-compute[71507]: DEBUG nova.compute.manager [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] No waiting events found dispatching network-vif-plugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:27:21 user nova-compute[71507]: WARNING nova.compute.manager [req-b3f99be4-8b0d-4b12-8cd4-0430fd99c85d req-844a07b4-cb0c-49a1-b7c6-2060ade91b64 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received unexpected event network-vif-plugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance with vm_state building and task_state spawning.
Apr 13 15:27:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:27:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:27:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Skipping network cache update for instance because it is Building. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 13 15:27:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:27:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:27:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:27:22 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updating instance_info_cache with network_info: [{"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399643.2519908, 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:27:23 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] VM Resumed (Lifecycle Event)
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:27:23 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Instance spawned successfully.
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:27:23 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399643.2533336, 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:27:23 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] VM Started (Lifecycle Event)
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:27:23 user nova-compute[71507]: INFO nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Took 5.69 seconds to spawn the instance on the hypervisor.
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:27:23 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received event network-vif-plugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] Acquiring lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] No waiting events found dispatching network-vif-plugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:27:23 user nova-compute[71507]: WARNING nova.compute.manager [req-883ddfb9-576d-4b34-b31f-23bf49abe1b9 req-42268e98-40e0-4a06-9147-1f4752208957 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received unexpected event network-vif-plugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance with vm_state building and task_state spawning.
Apr 13 15:27:23 user nova-compute[71507]: INFO nova.compute.manager [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Took 6.31 seconds to build instance.
Apr 13 15:27:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-8bb56ba6-3541-4d42-9fe3-8e4ce91584f8 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.390s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:25 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399630.4611518, 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:27:25 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] VM Stopped (Lifecycle Event)
Apr 13 15:27:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-f2d7e5d0-ef02-4fc8-bf6a-422d71ca5c9d None None] [instance: 37ff2115-ebfa-4cd2-b52f-89e354f0f5ba] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:27:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:27:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:27:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:27:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:27:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:27:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7975MB free_disk=26.09418487548828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 42464137-e247-4191-8ed4-4bbdbe392f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:27:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:27:39 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:40 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:44 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:27:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-changed-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:27:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Refreshing instance network info cache due to event network-changed-018bebd6-4323-4f9d-8c6d-6da9a7934a97. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:27:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] Acquiring lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:27:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] Acquired lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:27:54 user nova-compute[71507]: DEBUG nova.network.neutron [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Refreshing network info cache for port 018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:27:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:55 user nova-compute[71507]: DEBUG nova.network.neutron [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updated VIF entry in instance network info cache for port 018bebd6-4323-4f9d-8c6d-6da9a7934a97. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:27:55 user nova-compute[71507]: DEBUG nova.network.neutron [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updating instance_info_cache with network_info: [{"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:27:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c995056a-ab87-43a5-8591-1d12dbb594bb req-21fc25ca-108d-4c93-9564-77dc95f2f8ec service nova] Releasing lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:27:58 user nova-compute[71507]: INFO nova.compute.claims [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Claim successful on node user
Apr 13 15:27:58 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:27:58 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:27:58 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:27:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:27:58 user nova-compute[71507]: INFO nova.virt.block_device [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Booting with volume 3ec0bd78-5754-47ac-8a42-bbdd51d2d002 at /dev/vda
Apr 13 15:27:58 user nova-compute[71507]: DEBUG nova.policy [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c12c62d4137473596571e523163e718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9154e4239a1a42a3820c27563ba0513f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG os_brick.utils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a330db3-6197-41c8-91d9-580698167a22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[693afec2-8f79-4ca6-92b5-2ab9f01b0271]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[46456076-e0b8-4ffc-b898-a0d4af27c88b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b77e4a6-6dc7-4176-a83c-0cefa6d334db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:27:59 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:27:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64051656-d1f6-4357-bc81-ce9cc6db43d1]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG os_brick.utils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating existing volume attachment record: c530e721-2f70-4bb4-b49a-318405a71d78 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Successfully created port: e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:27:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received event network-changed-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Refreshing instance network info cache due to event network-changed-f72dcc71-6349-4489-8605-18cb581b5750. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] Acquiring lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] Acquired lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Refreshing network info cache for port f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.objects.instance [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'flavor' on Instance uuid ed13cfeb-933e-4cff-804a-f7404df7f2b0 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Successfully updated port: e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-changed-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Refreshing instance network info cache due to event network-changed-e42a12d0-d042-4277-83a6-7141c1df1ea2. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] Acquiring lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:00 user nova-compute[71507]: INFO nova.compute.manager [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Attaching volume cc8b0061-9677-4611-93cf-b64d28575c63 to /dev/vdb
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating instance_info_cache with network_info: [{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Instance network_info: |[{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] Acquired lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Refreshing network info cache for port e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Updated VIF entry in instance network info cache for port f72dcc71-6349-4489-8605-18cb581b5750. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Updating instance_info_cache with network_info: [{"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG os_brick.utils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a575afbb-2128-4431-8ff9-21077dfc2cc0 req-50707190-3f03-46f9-bf86-21c439be558c service nova] Releasing lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e1327d-49f6-439e-93e0-e67f6104e311]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223c2ef-222a-400a-9ddd-53cbbbae574c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5565e1c6-5731-4a9e-9ce7-3d6529dc21a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2531502c-2275-448b-8b7b-ac77fa9d69f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:28:01 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cc06ba-6f1d-400e-be6c-36c4d691147b]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG os_brick.utils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Updating existing volume attachment record: 82d161e2-c68a-49d8-acb2-25b72f76168d {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG nova.network.neutron [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updated VIF entry in instance network info cache for port e42a12d0-d042-4277-83a6-7141c1df1ea2. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG nova.network.neutron [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating instance_info_cache with network_info: [{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:28:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f918398f-d5ca-4656-a9ad-ca45f4f68721 req-348df57c-24cd-4071-9f52-6b24d44faa0c service nova] Releasing lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:28:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:28:03 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Creating image(s)
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Ensure instance console log exists: /opt/stack/data/nova/instances/4211d816-b8aa-452e-9587-bf131e42d643/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Start _get_guest_xml network_info=[{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRynUupX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4211d816-b8aa-452e-9587-bf131e42d643', 'attached_at': '', 'detached_at': '', 'volume_id': '3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'serial': '3ec0bd78-5754-47ac-8a42-bbdd51d2d002'}, 'attachment_id': 'c530e721-2f70-4bb4-b49a-318405a71d78', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:28:03 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:28:03 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRynUupX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:28:03 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:28:03 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:28:03 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4020ef89-a706-46fb-a654-c9e9144cba2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:28:03 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b252475-b334-4a94-815d-d6e97d34cc5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002] added
Apr 13 15:28:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cf9599-569d-4f8e-a9c7-458ed9ca4071]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4d8027-f281-474c-8735-1eb5a67e6281]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRynUupX {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRynUupX" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e5e3f5-5e45-4f6f-935a-e2ab7a653c71]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRynUupX'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ed1b17-985e-4219-8f20-37e7204dc2d3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee0c8ae-1671-4a53-b671-32f5f5dc3d27]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:28:03 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:28:03 user nova-compute[71507]:  {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:28:03 user nova-compute[71507]: WARNING os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 15:28:03 user nova-compute[71507]: 
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c2b847-2927-4793-bf8b-578fe26a49b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260]
Apr 13 15:28:03 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260] successful.
Apr 13 15:28:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd94277a-9859-49b6-9f3f-b49ba0f54ae5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa1f506-a4fd-4df5-b609-0bb8021a94fa]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:03 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c3de56-90a1-43f7-9cf4-32e9cdc2f1bf]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:28:03 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRynUupX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:28:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:28:04 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26636636233393263', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:28:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636636233393263', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:28:04 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-243297081',display_name='tempest-ServerActionsTestJSON-server-243297081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-243297081',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-c36rb19c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=4211d816-b8aa-452e-9587-bf131e42d643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:28:04 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:28:04 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:28:04 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'pci_devices' on Instance uuid 4211d816-b8aa-452e-9587-bf131e42d643 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:28:05 user nova-compute[71507]:   <uuid>4211d816-b8aa-452e-9587-bf131e42d643</uuid>
Apr 13 15:28:05 user nova-compute[71507]:   <name>instance-00000024</name>
Apr 13 15:28:05 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:28:05 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:28:05 user nova-compute[71507]:   <metadata>
Apr 13 15:28:05 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:28:05 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:28:05 user nova-compute[71507]:       <nova:name>tempest-ServerActionsTestJSON-server-243297081</nova:name>
Apr 13 15:28:05 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:28:03</nova:creationTime>
Apr 13 15:28:05 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:28:05 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:28:05 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:28:05 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:28:05 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:28:05 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:28:05 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:28:05 user nova-compute[71507]:       <nova:owner>
Apr 13 15:28:05 user nova-compute[71507]:         <nova:user uuid="3c12c62d4137473596571e523163e718">tempest-ServerActionsTestJSON-423674903-project-member</nova:user>
Apr 13 15:28:05 user nova-compute[71507]:         <nova:project uuid="9154e4239a1a42a3820c27563ba0513f">tempest-ServerActionsTestJSON-423674903</nova:project>
Apr 13 15:28:05 user nova-compute[71507]:       </nova:owner>
Apr 13 15:28:05 user nova-compute[71507]:       <nova:ports>
Apr 13 15:28:05 user nova-compute[71507]:         <nova:port uuid="e42a12d0-d042-4277-83a6-7141c1df1ea2">
Apr 13 15:28:05 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 15:28:05 user nova-compute[71507]:         </nova:port>
Apr 13 15:28:05 user nova-compute[71507]:       </nova:ports>
Apr 13 15:28:05 user nova-compute[71507]:     </nova:instance>
Apr 13 15:28:05 user nova-compute[71507]:   </metadata>
Apr 13 15:28:05 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:28:05 user nova-compute[71507]:     <system>
Apr 13 15:28:05 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:28:05 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:28:05 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:28:05 user nova-compute[71507]:       <entry name="serial">4211d816-b8aa-452e-9587-bf131e42d643</entry>
Apr 13 15:28:05 user nova-compute[71507]:       <entry name="uuid">4211d816-b8aa-452e-9587-bf131e42d643</entry>
Apr 13 15:28:05 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:28:05 user nova-compute[71507]:     </system>
Apr 13 15:28:05 user nova-compute[71507]:   </sysinfo>
Apr 13 15:28:05 user nova-compute[71507]:   <os>
Apr 13 15:28:05 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:28:05 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:28:05 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:28:05 user nova-compute[71507]:   </os>
Apr 13 15:28:05 user nova-compute[71507]:   <features>
Apr 13 15:28:05 user nova-compute[71507]:     <acpi/>
Apr 13 15:28:05 user nova-compute[71507]:     <apic/>
Apr 13 15:28:05 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:28:05 user nova-compute[71507]:   </features>
Apr 13 15:28:05 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:28:05 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:28:05 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:28:05 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:28:05 user nova-compute[71507]:   </clock>
Apr 13 15:28:05 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:28:05 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:28:05 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:28:05 user nova-compute[71507]:   </cpu>
Apr 13 15:28:05 user nova-compute[71507]:   <devices>
Apr 13 15:28:05 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:28:05 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:28:05 user nova-compute[71507]:       <source dev="/dev/sdb"/>
Apr 13 15:28:05 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:28:05 user nova-compute[71507]:       <serial>3ec0bd78-5754-47ac-8a42-bbdd51d2d002</serial>
Apr 13 15:28:05 user nova-compute[71507]:     </disk>
Apr 13 15:28:05 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:28:05 user nova-compute[71507]:       <mac address="fa:16:3e:9f:e0:7d"/>
Apr 13 15:28:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:28:05 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:28:05 user nova-compute[71507]:       <target dev="tape42a12d0-d0"/>
Apr 13 15:28:05 user nova-compute[71507]:     </interface>
Apr 13 15:28:05 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:28:05 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/4211d816-b8aa-452e-9587-bf131e42d643/console.log" append="off"/>
Apr 13 15:28:05 user nova-compute[71507]:     </serial>
Apr 13 15:28:05 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:28:05 user nova-compute[71507]:     <video>
Apr 13 15:28:05 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:28:05 user nova-compute[71507]:     </video>
Apr 13 15:28:05 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:28:05 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:28:05 user nova-compute[71507]:     </rng>
Apr 13 15:28:05 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:28:05 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:28:05 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:28:05 user nova-compute[71507]:     </memballoon>
Apr 13 15:28:05 user nova-compute[71507]:   </devices>
Apr 13 15:28:05 user nova-compute[71507]: </domain>
Apr 13 15:28:05 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-243297081',display_name='tempest-ServerActionsTestJSON-server-243297081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-243297081',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-c36rb19c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=4211d816-b8aa-452e-9587-bf131e42d643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_vif [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape42a12d0-d0, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape42a12d0-d0, col_values=(('external_ids', {'iface-id': 'e42a12d0-d042-4277-83a6-7141c1df1ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:e0:7d', 'vm-uuid': '4211d816-b8aa-452e-9587-bf131e42d643'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:05 user nova-compute[71507]: INFO os_vif [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0')
Apr 13 15:28:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No VIF found with MAC fa:16:3e:9f:e0:7d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdHWphMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:28:05 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:28:05 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:28:05 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed9b632-701e-466c-a37e-48e81397fcd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:28:05 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc51819-82e5-4cfa-9d8e-306376f12dfa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63] added
Apr 13 15:28:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb1648-7469-4c4f-a6ac-2c68cfe59146]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b3efa-7b87-4746-8505-41e43d00e5cf]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdHWphMU {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdHWphMU" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[50361364-f42d-4918-8711-1e20b3a68f02]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BdHWphMU'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7b7c4d-9d22-45a5-a67b-1eb0dad28e8a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e5464-b771-4dc6-9e2e-450bc68bf598]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --login" returned: 0 in 0.126s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b876d8-14c1-4800-abb5-d331f24ff678]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63, portal: 172.16.0.220,3260]
Apr 13 15:28:05 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63, portal: 172.16.0.220,3260] successful.
Apr 13 15:28:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd18a7fd-3a3b-4eaa-80c6-8e8568c60bdf]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e719867b-403e-4bb2-9d1c-715abe47aa75]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:05 user nova-compute[71507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 (non-flash)
Apr 13 15:28:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:05 user nova-compute[71507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 (non-flash)
Apr 13 15:28:05 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a8091f-e839-46ab-a2bb-f5366aeb8d1c]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:28:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdHWphMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] No waiting events found dispatching network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:28:06 user nova-compute[71507]: WARNING nova.compute.manager [req-c83eff12-e893-403e-a8ee-6d2a7cde76dc req-73eddbc7-05db-4e37-bfd2-472c07aceb0c service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received unexpected event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance with vm_state building and task_state spawning.
Apr 13 15:28:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23832303439393639', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832303439393639', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG nova.objects.instance [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'flavor' on Instance uuid ed13cfeb-933e-4cff-804a-f7404df7f2b0 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:28:06 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:28:06 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:28:06 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:28:06 user nova-compute[71507]:   <serial>cc8b0061-9677-4611-93cf-b64d28575c63</serial>
Apr 13 15:28:06 user nova-compute[71507]: </disk>
Apr 13 15:28:06 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:28:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:28:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:28:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] No VIF found with MAC fa:16:3e:f9:a9:90, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:28:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-3dbc37c3-e99b-47b4-b30d-d902d0189ed9 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.712s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399688.5468292, 4211d816-b8aa-452e-9587-bf131e42d643 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:28:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] VM Resumed (Lifecycle Event)
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:28:08 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Instance spawned successfully.
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399688.5485284, 4211d816-b8aa-452e-9587-bf131e42d643 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:28:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] VM Started (Lifecycle Event)
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] No waiting events found dispatching network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:28:08 user nova-compute[71507]: WARNING nova.compute.manager [req-3c5f9d8e-9f81-4056-ab66-897c5e3f2c0f req-15c9db73-709f-48e0-a009-82474c8c22a9 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received unexpected event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance with vm_state building and task_state spawning.
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:28:08 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:28:08 user nova-compute[71507]: INFO nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Took 5.06 seconds to spawn the instance on the hypervisor.
Apr 13 15:28:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:28:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:08 user nova-compute[71507]: INFO nova.compute.manager [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Took 10.51 seconds to build instance.
Apr 13 15:28:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c15383b4-5af8-476a-9ba1-1ac039e3d226 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.607s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:09 user nova-compute[71507]: INFO nova.compute.manager [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Detaching volume cc8b0061-9677-4611-93cf-b64d28575c63
Apr 13 15:28:09 user nova-compute[71507]: INFO nova.virt.block_device [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Attempting to driver detach volume cc8b0061-9677-4611-93cf-b64d28575c63 from mountpoint /dev/vdb
Apr 13 15:28:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Attempting to detach device vdb from instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:28:09 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:28:09 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:28:09 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:28:09 user nova-compute[71507]:   <serial>cc8b0061-9677-4611-93cf-b64d28575c63</serial>
Apr 13 15:28:09 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:28:09 user nova-compute[71507]: </disk>
Apr 13 15:28:09 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:28:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Successfully detached device vdb from instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 from the persistent domain config.
Apr 13 15:28:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:28:09 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:28:09 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:28:09 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:28:09 user nova-compute[71507]:   <serial>cc8b0061-9677-4611-93cf-b64d28575c63</serial>
Apr 13 15:28:09 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:28:09 user nova-compute[71507]: </disk>
Apr 13 15:28:09 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399689.7158282, ed13cfeb-933e-4cff-804a-f7404df7f2b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:28:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Successfully detached device vdb from instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 from the live domain config.
Apr 13 15:28:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdHWphMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:28:09 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[698d2e18-b238-4c71-a303-48ecc9506eaa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:28:09 user nova-compute[71507]: No targets found.
Apr 13 15:28:09 user nova-compute[71507]: iSNS:
Apr 13 15:28:09 user nova-compute[71507]: No targets found.
Apr 13 15:28:09 user nova-compute[71507]: STATIC:
Apr 13 15:28:09 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002
Apr 13 15:28:09 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:28:09 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:28:09 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63
Apr 13 15:28:09 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:28:09 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:28:09 user nova-compute[71507]: FIRMWARE:
Apr 13 15:28:09 user nova-compute[71507]: No targets found.
Apr 13 15:28:09 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:28:09 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:28:09 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3dc7ff-addb-4288-bd2a-be1e4a4a6c6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f8c1b3-0145-4ba8-9c20-056a08b9e414]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:09 user nova-compute[71507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 (non-flash)
Apr 13 15:28:09 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:09 user nova-compute[71507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 (non-flash)
Apr 13 15:28:09 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c1b5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d8b69a-870e-4963-9a79-01025ff9a8a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2faaaf-f8df-4d2a-80f7-e7826c4d0c38]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[06828e93-f810-4df7-bc13-1b182fa028f2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eafc9d-3bb2-41d9-b1c4-401609e253cf]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fad5f5-1ceb-4bd4-aa4b-6326b6e8bd42]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9dcfda-dc96-46fe-9f56-fbd490f68197]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63, portal: 172.16.0.220,3260]
Apr 13 15:28:10 user nova-compute[71507]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63, portal: 172.16.0.220,3260] successful.
Apr 13 15:28:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b0061-9677-4611-93cf-b64d28575c63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[92305009-40f2-459b-b1b0-f27490a096ec]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] <== disconnect_volume: return (338ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received event network-changed-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG nova.compute.manager [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Refreshing instance network info cache due to event network-changed-4c0cf892-f8a1-4d12-b359-b2673ecfd984. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] Acquiring lock "refresh_cache-e1dcf028-0a0b-4b9d-b654-40f7627ebd36" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] Acquired lock "refresh_cache-e1dcf028-0a0b-4b9d-b654-40f7627ebd36" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:28:10 user nova-compute[71507]: DEBUG nova.network.neutron [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Refreshing network info cache for port 4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'flavor' on Instance uuid ed13cfeb-933e-4cff-804a-f7404df7f2b0 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-55b13ad0-b520-48c2-9e70-dfdc408cc5c7 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.966s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Updated VIF entry in instance network info cache for port 4c0cf892-f8a1-4d12-b359-b2673ecfd984. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG nova.network.neutron [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Updating instance_info_cache with network_info: [{"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c633bce6-24e1-450d-bcfe-b396f2bfdff2 req-bdaf1369-1627-49bb-b4a8-14388eb3441e service nova] Releasing lock "refresh_cache-e1dcf028-0a0b-4b9d-b654-40f7627ebd36" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'flavor' on Instance uuid e1dcf028-0a0b-4b9d-b654-40f7627ebd36 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:12 user nova-compute[71507]: INFO nova.compute.manager [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Attaching volume 92dff935-eedc-429a-8156-42f94b0a52eb to /dev/vdb
Apr 13 15:28:12 user nova-compute[71507]: DEBUG os_brick.utils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a3e301-4626-418f-b8d5-4596df2dd4bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd6d25-c034-4e8a-8e03-6fd9d87e1e44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ac91f-6473-4fb4-8e57-d852379a8661]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a1c9d1-1343-4622-8b7c-eba0573e6cf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:28:12 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:28:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf5c91-82ab-42f8-b5d3-a6a9f7094038]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG os_brick.utils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:28:12 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Updating existing volume attachment record: e1ca0dfc-dd53-4321-a35e-42f08f989a8d {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:28:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:28:14 user nova-compute[71507]: INFO nova.compute.claims [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Claim successful on node user
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:28:14 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.policy [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:28:14 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Creating image(s)
Apr 13 15:28:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.143s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk 1073741824" returned: 0 in 0.053s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.157s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Cannot resize image /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'migration_context' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Ensure instance console log exists: /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:15 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Successfully created port: e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Successfully updated port: e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquired lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-changed-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Refreshing instance network info cache due to event network-changed-e2eabaa4-a35d-433f-850e-949af795e7ed. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] Acquiring lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCuxOUiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:28:16 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:28:16 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:28:16 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5c2a67-0de0-4be9-93a3-757226a51dcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:28:16 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8654cd1e-0546-4d9c-ac6b-91431deb698f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb] added
Apr 13 15:28:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating instance_info_cache with network_info: [{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3edbf5d-09cd-434b-a1ad-1a6ce251fb3b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Releasing lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance network_info: |[{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] Acquired lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.network.neutron [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Refreshing network info cache for port e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Start _get_guest_xml network_info=[{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:28:16 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:28:16 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-685773624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-685773624',id=37,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwAMm4sU/Gj3Vzrh3VZEg6lMGBJZ4u46yLNWpEl8KgjKMuyhNTe4lr+wZMx5cIPjHcyJlvVwL2g6JxTANaHJ7wVMvtjiUslCjAeTc41ba0ytt3OvquWPsvKDw4riIwsTg==',key_name='tempest-keypair-1306550106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-v5c2531s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=9761101e-4bce-4e7b-8137-569bf8d27f87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'pci_devices' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4135f479-12df-4689-9b68-eb3d3e5b90e6]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCuxOUiI {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:28:16 user nova-compute[71507]:   <uuid>9761101e-4bce-4e7b-8137-569bf8d27f87</uuid>
Apr 13 15:28:16 user nova-compute[71507]:   <name>instance-00000025</name>
Apr 13 15:28:16 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:28:16 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:28:16 user nova-compute[71507]:   <metadata>
Apr 13 15:28:16 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:28:16 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:28:16 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-685773624</nova:name>
Apr 13 15:28:16 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:28:16</nova:creationTime>
Apr 13 15:28:16 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:28:16 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:28:16 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:28:16 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:28:16 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:28:16 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:28:16 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:28:16 user nova-compute[71507]:       <nova:owner>
Apr 13 15:28:16 user nova-compute[71507]:         <nova:user uuid="a0bc1b61d8dc44aa8460fe2cd510c0a4">tempest-AttachVolumeShelveTestJSON-1608248430-project-member</nova:user>
Apr 13 15:28:16 user nova-compute[71507]:         <nova:project uuid="51df4613a6664a0fab857a9a83b6df62">tempest-AttachVolumeShelveTestJSON-1608248430</nova:project>
Apr 13 15:28:16 user nova-compute[71507]:       </nova:owner>
Apr 13 15:28:16 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:28:16 user nova-compute[71507]:       <nova:ports>
Apr 13 15:28:16 user nova-compute[71507]:         <nova:port uuid="e2eabaa4-a35d-433f-850e-949af795e7ed">
Apr 13 15:28:16 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 15:28:16 user nova-compute[71507]:         </nova:port>
Apr 13 15:28:16 user nova-compute[71507]:       </nova:ports>
Apr 13 15:28:16 user nova-compute[71507]:     </nova:instance>
Apr 13 15:28:16 user nova-compute[71507]:   </metadata>
Apr 13 15:28:16 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:28:16 user nova-compute[71507]:     <system>
Apr 13 15:28:16 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:28:16 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:28:16 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:28:16 user nova-compute[71507]:       <entry name="serial">9761101e-4bce-4e7b-8137-569bf8d27f87</entry>
Apr 13 15:28:16 user nova-compute[71507]:       <entry name="uuid">9761101e-4bce-4e7b-8137-569bf8d27f87</entry>
Apr 13 15:28:16 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:28:16 user nova-compute[71507]:     </system>
Apr 13 15:28:16 user nova-compute[71507]:   </sysinfo>
Apr 13 15:28:16 user nova-compute[71507]:   <os>
Apr 13 15:28:16 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:28:16 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:28:16 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:28:16 user nova-compute[71507]:   </os>
Apr 13 15:28:16 user nova-compute[71507]:   <features>
Apr 13 15:28:16 user nova-compute[71507]:     <acpi/>
Apr 13 15:28:16 user nova-compute[71507]:     <apic/>
Apr 13 15:28:16 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:28:16 user nova-compute[71507]:   </features>
Apr 13 15:28:16 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:28:16 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:28:16 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:28:16 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:28:16 user nova-compute[71507]:   </clock>
Apr 13 15:28:16 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:28:16 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:28:16 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:28:16 user nova-compute[71507]:   </cpu>
Apr 13 15:28:16 user nova-compute[71507]:   <devices>
Apr 13 15:28:16 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:28:16 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:28:16 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk"/>
Apr 13 15:28:16 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:28:16 user nova-compute[71507]:     </disk>
Apr 13 15:28:16 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:28:16 user nova-compute[71507]:       <mac address="fa:16:3e:bd:e2:6c"/>
Apr 13 15:28:16 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:28:16 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:28:16 user nova-compute[71507]:       <target dev="tape2eabaa4-a3"/>
Apr 13 15:28:16 user nova-compute[71507]:     </interface>
Apr 13 15:28:16 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:28:16 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/console.log" append="off"/>
Apr 13 15:28:16 user nova-compute[71507]:     </serial>
Apr 13 15:28:16 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:28:16 user nova-compute[71507]:     <video>
Apr 13 15:28:16 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:28:16 user nova-compute[71507]:     </video>
Apr 13 15:28:16 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:28:16 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:28:16 user nova-compute[71507]:     </rng>
Apr 13 15:28:16 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:28:16 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:28:16 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:28:16 user nova-compute[71507]:     </memballoon>
Apr 13 15:28:16 user nova-compute[71507]:   </devices>
Apr 13 15:28:16 user nova-compute[71507]: </domain>
Apr 13 15:28:16 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-685773624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-685773624',id=37,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwAMm4sU/Gj3Vzrh3VZEg6lMGBJZ4u46yLNWpEl8KgjKMuyhNTe4lr+wZMx5cIPjHcyJlvVwL2g6JxTANaHJ7wVMvtjiUslCjAeTc41ba0ytt3OvquWPsvKDw4riIwsTg==',key_name='tempest-keypair-1306550106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-v5c2531s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=9761101e-4bce-4e7b-8137-569bf8d27f87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_vif [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2eabaa4-a3, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2eabaa4-a3, col_values=(('external_ids', {'iface-id': 'e2eabaa4-a35d-433f-850e-949af795e7ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:e2:6c', 'vm-uuid': '9761101e-4bce-4e7b-8137-569bf8d27f87'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCuxOUiI" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa009f8-fc9b-4af3-8fe1-adc7396838e0]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qCuxOUiI'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:16 user nova-compute[71507]: INFO os_vif [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3')
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8e67ed-a789-4384-b963-82a1157a131a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a5d8d4-aec4-4f20-ab72-7eadef161489]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] No VIF found with MAC fa:16:3e:bd:e2:6c, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd670ca5-901c-4d41-9d79-6bae2054fe73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb, portal: 172.16.0.220,3260]
Apr 13 15:28:16 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb, portal: 172.16.0.220,3260] successful.
Apr 13 15:28:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3906ac27-02fa-4242-a591-74befc5719c7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0d30af-8f69-4233-9d81-b97af7e3ebab]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:16 user nova-compute[71507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb (non-flash)
Apr 13 15:28:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:16 user nova-compute[71507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb (non-flash)
Apr 13 15:28:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee9594e-8a1b-4ea6-a793-4ecce6b65d7a]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:28:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCuxOUiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:28:17 user nova-compute[71507]: DEBUG nova.network.neutron [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updated VIF entry in instance network info cache for port e2eabaa4-a35d-433f-850e-949af795e7ed. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:28:17 user nova-compute[71507]: DEBUG nova.network.neutron [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating instance_info_cache with network_info: [{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:28:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-73279d8d-f633-4110-ad9b-054aa524071b req-1b579b30-fe37-4bc1-9a70-47a283d37b5b service nova] Releasing lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:28:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:28:17 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23665643236313665', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:28:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665643236313665', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:28:17 user nova-compute[71507]: DEBUG nova.objects.instance [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'flavor' on Instance uuid e1dcf028-0a0b-4b9d-b654-40f7627ebd36 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:28:17 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:28:17 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:28:17 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:28:17 user nova-compute[71507]:   <serial>92dff935-eedc-429a-8156-42f94b0a52eb</serial>
Apr 13 15:28:17 user nova-compute[71507]: </disk>
Apr 13 15:28:17 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG nova.compute.manager [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] No waiting events found dispatching network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:28:18 user nova-compute[71507]: WARNING nova.compute.manager [req-8eeeaf15-538a-43c6-ae8d-95acaf2edad0 req-7c7574b3-2c37-4217-b23d-8694c3495ff6 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received unexpected event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed for instance with vm_state building and task_state spawning.
Apr 13 15:28:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] No VIF found with MAC fa:16:3e:23:16:13, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-60124c72-5bb8-4abe-a68b-c76f1509ce6a tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.638s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.compute.manager [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Detaching volume 92dff935-eedc-429a-8156-42f94b0a52eb
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.virt.block_device [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Attempting to driver detach volume 92dff935-eedc-429a-8156-42f94b0a52eb from mountpoint /dev/vdb
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Attempting to detach device vdb from instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:28:20 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:28:20 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:28:20 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:28:20 user nova-compute[71507]:   <serial>92dff935-eedc-429a-8156-42f94b0a52eb</serial>
Apr 13 15:28:20 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:28:20 user nova-compute[71507]: </disk>
Apr 13 15:28:20 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully detached device vdb from instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 from the persistent domain config.
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:28:20 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:28:20 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:28:20 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:28:20 user nova-compute[71507]:   <serial>92dff935-eedc-429a-8156-42f94b0a52eb</serial>
Apr 13 15:28:20 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:28:20 user nova-compute[71507]: </disk>
Apr 13 15:28:20 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.compute.manager [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] No waiting events found dispatching network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:28:20 user nova-compute[71507]: WARNING nova.compute.manager [req-50cdfd9d-72d2-434b-80cd-c4a84b831f75 req-5a982ede-2ad4-4deb-ac1d-e2fabc4fa9bf service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received unexpected event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed for instance with vm_state building and task_state spawning.
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681399700.6314967, e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully detached device vdb from instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 from the live domain config.
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCuxOUiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:28:20 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cc4d9e-5e9f-4429-b0cc-89773dda81f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:28:20 user nova-compute[71507]: No targets found.
Apr 13 15:28:20 user nova-compute[71507]: iSNS:
Apr 13 15:28:20 user nova-compute[71507]: No targets found.
Apr 13 15:28:20 user nova-compute[71507]: STATIC:
Apr 13 15:28:20 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002
Apr 13 15:28:20 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:28:20 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:28:20 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb
Apr 13 15:28:20 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:28:20 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:28:20 user nova-compute[71507]: FIRMWARE:
Apr 13 15:28:20 user nova-compute[71507]: No targets found.
Apr 13 15:28:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:28:20 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:28:20 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b6e689-67c2-48f2-9b93-c8242228cc72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399700.6985104, 9761101e-4bce-4e7b-8137-569bf8d27f87 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] VM Resumed (Lifecycle Event)
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63862c47-6cd6-4c65-a12b-50fe49f8b513]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:20 user nova-compute[71507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb (non-flash)
Apr 13 15:28:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:28:20 user nova-compute[71507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb (non-flash)
Apr 13 15:28:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab28925480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance spawned successfully.
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e097d6c9-647f-4059-878e-7f6faa4788be]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399700.706965, 9761101e-4bce-4e7b-8137-569bf8d27f87 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] VM Started (Lifecycle Event)
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4f8a85-92c0-4d0e-82b8-b91225963554]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[53503f7d-768b-4d25-a2f9-262d343adb29]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Took 5.97 seconds to spawn the instance on the hypervisor.
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4244c253-9fda-41ce-9ad5-683bee16cc6d]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7954dc9-3d17-4716-8b2f-4c775e337655]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: INFO nova.compute.manager [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Took 6.68 seconds to build instance.
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffc5392-9f60-4f5e-b9ce-1835ed578d1f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb, portal: 172.16.0.220,3260]
Apr 13 15:28:20 user nova-compute[71507]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb, portal: 172.16.0.220,3260] successful.
Apr 13 15:28:20 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c2068082-dcb3-44cf-a902-5b7e49799f98 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.779s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92dff935-eedc-429a-8156-42f94b0a52eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f96adb-6fdc-4275-abc8-3c7196dcab5f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] <== disconnect_volume: return (306ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:28:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:28:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:21 user nova-compute[71507]: DEBUG nova.objects.instance [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'flavor' on Instance uuid e1dcf028-0a0b-4b9d-b654-40f7627ebd36 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-2cbebaac-a450-4c04-959e-b30a5c53e73f tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.709s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:22 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:28:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:28:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:28:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:28:23 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Updating instance_info_cache with network_info: [{"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:28:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:28:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:28:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances with incomplete migration  {{(pid=71507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 15:28:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:30 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 15:28:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] There are 0 instances to clean {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 15:28:30 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:28:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:28:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=7863MB free_disk=26.043445587158203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 42464137-e247-4191-8ed4-4bbdbe392f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance ed13cfeb-933e-4cff-804a-f7404df7f2b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 4211d816-b8aa-452e-9587-bf131e42d643 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing inventories for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating ProviderTree inventory for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing aggregate associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, aggregates: None {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 15:28:36 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing trait associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 15:28:37 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:28:37 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:28:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:28:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:40 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:40 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:40 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:28:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:45 user nova-compute[71507]: INFO nova.compute.manager [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Terminating instance
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:28:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Instance destroyed successfully.
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lazy-loading 'resources' on Instance uuid 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-539053316',display_name='tempest-VolumesActionsTest-instance-539053316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-539053316',id=34,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:26:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c21b26110ef24c259a7f45913f46d6af',ramdisk_id='',reservation_id='r-a5iqdn8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1866117776',owner_user_name='tempest-VolumesActionsTest-1866117776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:26:57Z,user_data=None,user_id='6fd5e19b47fa493395ca0432e6d85251',uuid=2dba94be-8cb8-477e-aa7f-0239b9cdc4a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Converting VIF {"id": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "address": "fa:16:3e:25:7d:6b", "network": {"id": "83cf3a37-c06c-4968-b7be-db5b44d56301", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1251758166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c21b26110ef24c259a7f45913f46d6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7faa0d-96", "ovs_interfaceid": "be7faa0d-9682-48e3-9a50-db4d80d7a54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:7d:6b,bridge_name='br-int',has_traffic_filtering=True,id=be7faa0d-9682-48e3-9a50-db4d80d7a54a,network=Network(83cf3a37-c06c-4968-b7be-db5b44d56301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7faa0d-96') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG os_vif [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:7d:6b,bridge_name='br-int',has_traffic_filtering=True,id=be7faa0d-9682-48e3-9a50-db4d80d7a54a,network=Network(83cf3a37-c06c-4968-b7be-db5b44d56301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7faa0d-96') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe7faa0d-96, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:28:45 user nova-compute[71507]: INFO os_vif [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:7d:6b,bridge_name='br-int',has_traffic_filtering=True,id=be7faa0d-9682-48e3-9a50-db4d80d7a54a,network=Network(83cf3a37-c06c-4968-b7be-db5b44d56301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7faa0d-96')
Apr 13 15:28:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Deleting instance files /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1_del
Apr 13 15:28:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Deletion of /opt/stack/data/nova/instances/2dba94be-8cb8-477e-aa7f-0239b9cdc4a1_del complete
Apr 13 15:28:45 user nova-compute[71507]: INFO nova.compute.manager [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received event network-vif-unplugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] Acquiring lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] No waiting events found dispatching network-vif-unplugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:28:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-4d2b1e4f-f67b-46fb-a411-542a8819b615 req-e173e661-4955-4ba6-9de4-b09e1a81083c service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received event network-vif-unplugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:28:46 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:28:46 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Took 0.49 seconds to deallocate network for instance.
Apr 13 15:28:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-3975edf5-40eb-4ecb-b231-fb2d5412a17d req-1382dd62-1c82-421c-8367-5b27fee5ba89 service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received event network-vif-deleted-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:46 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:28:46 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:28:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:46 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Deleted allocations for instance 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1
Apr 13 15:28:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ed72c4f1-be03-41da-911c-fb0bc29f6b08 tempest-VolumesActionsTest-1866117776 tempest-VolumesActionsTest-1866117776-project-member] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.621s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received event network-vif-plugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] Acquiring lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] Lock "2dba94be-8cb8-477e-aa7f-0239b9cdc4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:48 user nova-compute[71507]: DEBUG nova.compute.manager [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] No waiting events found dispatching network-vif-plugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:28:48 user nova-compute[71507]: WARNING nova.compute.manager [req-61d6c4ff-6161-4913-b1cb-c43d35ae4ca4 req-f9ed2db5-1c3d-44e3-a5c5-aa61fbb4cf8f service nova] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Received unexpected event network-vif-plugged-be7faa0d-9682-48e3-9a50-db4d80d7a54a for instance with vm_state deleted and task_state None.
Apr 13 15:28:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG nova.compute.manager [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received event network-changed-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG nova.compute.manager [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Refreshing instance network info cache due to event network-changed-f72dcc71-6349-4489-8605-18cb581b5750. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] Acquiring lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] Acquired lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG nova.network.neutron [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Refreshing network info cache for port f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:28:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:28:59 user nova-compute[71507]: INFO nova.compute.manager [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Terminating instance
Apr 13 15:28:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Updated VIF entry in instance network info cache for port f72dcc71-6349-4489-8605-18cb581b5750. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.network.neutron [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Updating instance_info_cache with network_info: [{"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5d80e3a2-fa38-4fcd-b0f8-a7badcae0c69 req-f71d330f-1b83-417c-9741-48f0a6fc61f6 service nova] Releasing lock "refresh_cache-ed13cfeb-933e-4cff-804a-f7404df7f2b0" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399725.7551, 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:29:00 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] VM Stopped (Lifecycle Event)
Apr 13 15:29:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Instance destroyed successfully.
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'resources' on Instance uuid ed13cfeb-933e-4cff-804a-f7404df7f2b0 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-56e44c71-3973-4a50-bb25-cb99b906e1b1 None None] [instance: 2dba94be-8cb8-477e-aa7f-0239b9cdc4a1] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1014644686',display_name='tempest-TestStampPattern-server-1014644686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1014644686',id=32,image_ref='d01d37a3-eaac-4176-9a21-d48e499cdde1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAksZCequnPeyEoxbRX4FTqaIZECithWpaNGXiycVZEBPtiDQC3OzUbnYo2ImPDa8dvWI39XTOjrHTgd99yZNpia3NMbHa+IllMmi0NURtQ7qbFcLr5JTdfFUpnNv2P7uA==',key_name='tempest-TestStampPattern-1982719940',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:26:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='318b9e0eb6a745df811d1daa4d6195fc',ramdisk_id='',reservation_id='r-q38nc5mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='42464137-e247-4191-8ed4-4bbdbe392f95',image_min_disk='1',image_min_ram='0',image_owner_id='318b9e0eb6a745df811d1daa4d6195fc',image_owner_project_name='tempest-TestStampPattern-1572934421',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1572934421-project-member',image_user_id='78e289648c244c77ab9ca48154da3cde',owner_project_name='tempest-TestStampPattern-1572934421',owner_user_name='tempest-TestStampPattern-1572934421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:26:15Z,user_data=None,user_id='78e289648c244c77ab9ca48154da3cde',uuid=ed13cfeb-933e-4cff-804a-f7404df7f2b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converting VIF {"id": "f72dcc71-6349-4489-8605-18cb581b5750", "address": "fa:16:3e:f9:a9:90", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf72dcc71-63", "ovs_interfaceid": "f72dcc71-6349-4489-8605-18cb581b5750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a9:90,bridge_name='br-int',has_traffic_filtering=True,id=f72dcc71-6349-4489-8605-18cb581b5750,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf72dcc71-63') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG os_vif [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a9:90,bridge_name='br-int',has_traffic_filtering=True,id=f72dcc71-6349-4489-8605-18cb581b5750,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf72dcc71-63') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf72dcc71-63, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:00 user nova-compute[71507]: INFO os_vif [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a9:90,bridge_name='br-int',has_traffic_filtering=True,id=f72dcc71-6349-4489-8605-18cb581b5750,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf72dcc71-63')
Apr 13 15:29:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Deleting instance files /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0_del
Apr 13 15:29:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Deletion of /opt/stack/data/nova/instances/ed13cfeb-933e-4cff-804a-f7404df7f2b0_del complete
Apr 13 15:29:00 user nova-compute[71507]: INFO nova.compute.manager [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 15:29:00 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:29:00 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:01 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Took 0.79 seconds to deallocate network for instance.
Apr 13 15:29:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-e58943bb-441c-47de-ac32-8521e1297e8e req-ce465a2f-001e-4f2a-ac60-a738a46aa7de service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received event network-vif-deleted-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received event network-vif-unplugged-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] No waiting events found dispatching network-vif-unplugged-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:01 user nova-compute[71507]: WARNING nova.compute.manager [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received unexpected event network-vif-unplugged-f72dcc71-6349-4489-8605-18cb581b5750 for instance with vm_state deleted and task_state None.
Apr 13 15:29:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received event network-vif-plugged-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Acquiring lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] No waiting events found dispatching network-vif-plugged-f72dcc71-6349-4489-8605-18cb581b5750 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:01 user nova-compute[71507]: WARNING nova.compute.manager [req-d2d779e2-5e02-4307-a6cf-4f7440048bb7 req-db1a6972-cfe7-4f0a-b1d8-c72d3d96435a service nova] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Received unexpected event network-vif-plugged-f72dcc71-6349-4489-8605-18cb581b5750 for instance with vm_state deleted and task_state None.
Apr 13 15:29:01 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:29:01 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:29:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:02 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Deleted allocations for instance ed13cfeb-933e-4cff-804a-f7404df7f2b0
Apr 13 15:29:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddbc3ad4-d85f-46d5-a52f-9fb8b7a8b18c tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "ed13cfeb-933e-4cff-804a-f7404df7f2b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.158s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:07 user nova-compute[71507]: INFO nova.compute.manager [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Terminating instance
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received event network-vif-unplugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] Acquiring lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] No waiting events found dispatching network-vif-unplugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-f60e1da5-8fb9-4f21-9baa-560c29182c82 req-f2ce3940-d890-4a82-bec0-1d64350b14f5 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received event network-vif-unplugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Instance destroyed successfully.
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.objects.instance [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lazy-loading 'resources' on Instance uuid 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:27:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-504850890',display_name='tempest-ServersNegativeTestJSON-server-504850890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-504850890',id=35,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ac07b9454744832b26bf6bd126763ec',ramdisk_id='',reservation_id='r-a0vf85md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-187650290',owner_user_name='tempest-ServersNegativeTestJSON-187650290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:27:23Z,user_data=None,user_id='3a6955546e4f4292a25acad709d27953',uuid=8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converting VIF {"id": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "address": "fa:16:3e:16:ec:8b", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8276bf9-69", "ovs_interfaceid": "d8276bf9-698e-4940-bace-2aee0c73f7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=d8276bf9-698e-4940-bace-2aee0c73f7d8,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8276bf9-69') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG os_vif [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=d8276bf9-698e-4940-bace-2aee0c73f7d8,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8276bf9-69') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8276bf9-69, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:07 user nova-compute[71507]: INFO os_vif [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ec:8b,bridge_name='br-int',has_traffic_filtering=True,id=d8276bf9-698e-4940-bace-2aee0c73f7d8,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8276bf9-69')
Apr 13 15:29:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Deleting instance files /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b_del
Apr 13 15:29:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Deletion of /opt/stack/data/nova/instances/8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b_del complete
Apr 13 15:29:07 user nova-compute[71507]: INFO nova.compute.manager [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 13 15:29:07 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:29:07 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:29:08 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:08 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Took 0.43 seconds to deallocate network for instance.
Apr 13 15:29:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received event network-vif-deleted-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:08 user nova-compute[71507]: INFO nova.compute.manager [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Neutron deleted interface d8276bf9-698e-4940-bace-2aee0c73f7d8; detaching it from the instance and deleting it from the info cache
Apr 13 15:29:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:08 user nova-compute[71507]: DEBUG nova.compute.manager [req-2aa0da47-32e2-4af3-a386-9e1f26171c43 req-97bf5814-e227-4fb6-bd9c-3bd44e8ba995 service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Detach interface failed, port_id=d8276bf9-698e-4940-bace-2aee0c73f7d8, reason: Instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:29:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:08 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:29:08 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:29:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:08 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Deleted allocations for instance 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b
Apr 13 15:29:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-512fefa6-d67f-4f35-badf-647b8cafee00 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.604s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received event network-vif-plugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] Acquiring lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] Lock "8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] No waiting events found dispatching network-vif-plugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:09 user nova-compute[71507]: WARNING nova.compute.manager [req-ca4d2c0f-dc3b-458d-91a7-6a04d22a98aa req-71fd6829-bb72-4854-990b-5929201328bc service nova] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Received unexpected event network-vif-plugged-d8276bf9-698e-4940-bace-2aee0c73f7d8 for instance with vm_state deleted and task_state None.
Apr 13 15:29:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:10 user nova-compute[71507]: INFO nova.compute.manager [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Terminating instance
Apr 13 15:29:10 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:29:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:11 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Instance destroyed successfully.
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lazy-loading 'resources' on Instance uuid e1dcf028-0a0b-4b9d-b654-40f7627ebd36 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-478534840',display_name='tempest-AttachVolumeNegativeTest-server-478534840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-478534840',id=33,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBeFSuWghn2ppx3LV4kwZSZ9u3eFqKrqHzSj6nztIlK6sepsmjvLDfGRp5YpOTa3ynO1wxxPjRYQuPWi1qCH33zqkCZqjkRoS2IFUvCmStWVu+wnE1oyDC/D062bqzoaw==',key_name='tempest-keypair-99368010',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e3ba2d132c445039d0ae30ffd2bc64a',ramdisk_id='',reservation_id='r-h2we3v82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-416139458',owner_user_name='tempest-AttachVolumeNegativeTest-416139458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:26:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fedd34ccc15c47f9a4fc96b080730acd',uuid=e1dcf028-0a0b-4b9d-b654-40f7627ebd36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converting VIF {"id": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "address": "fa:16:3e:23:16:13", "network": {"id": "547bb22a-22b3-4b8b-ab87-e4eb4af27619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1889321093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e3ba2d132c445039d0ae30ffd2bc64a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0cf892-f8", "ovs_interfaceid": "4c0cf892-f8a1-4d12-b359-b2673ecfd984", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:16:13,bridge_name='br-int',has_traffic_filtering=True,id=4c0cf892-f8a1-4d12-b359-b2673ecfd984,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0cf892-f8') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG os_vif [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:16:13,bridge_name='br-int',has_traffic_filtering=True,id=4c0cf892-f8a1-4d12-b359-b2673ecfd984,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0cf892-f8') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c0cf892-f8, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:11 user nova-compute[71507]: INFO os_vif [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:16:13,bridge_name='br-int',has_traffic_filtering=True,id=4c0cf892-f8a1-4d12-b359-b2673ecfd984,network=Network(547bb22a-22b3-4b8b-ab87-e4eb4af27619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0cf892-f8')
Apr 13 15:29:11 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Deleting instance files /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36_del
Apr 13 15:29:11 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Deletion of /opt/stack/data/nova/instances/e1dcf028-0a0b-4b9d-b654-40f7627ebd36_del complete
Apr 13 15:29:11 user nova-compute[71507]: INFO nova.compute.manager [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 13 15:29:11 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received event network-vif-unplugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] No waiting events found dispatching network-vif-unplugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received event network-vif-unplugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received event network-vif-plugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Acquiring lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] No waiting events found dispatching network-vif-plugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:11 user nova-compute[71507]: WARNING nova.compute.manager [req-274a582c-5571-4a9f-b8e9-520f8f8bdc4c req-8df82aa8-2a34-4670-844b-a390b948e899 service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received unexpected event network-vif-plugged-4c0cf892-f8a1-4d12-b359-b2673ecfd984 for instance with vm_state active and task_state deleting.
Apr 13 15:29:12 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:12 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Took 1.04 seconds to deallocate network for instance.
Apr 13 15:29:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:12 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:29:12 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:29:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-17fa331e-90f8-4879-a737-87f480b3f674 req-c4d08bf4-1352-4fd0-8200-b11567c034af service nova] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Received event network-vif-deleted-4c0cf892-f8a1-4d12-b359-b2673ecfd984 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:12 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Deleted allocations for instance e1dcf028-0a0b-4b9d-b654-40f7627ebd36
Apr 13 15:29:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b5c9efd4-6f5a-4fd9-b904-22b9dd696b2d tempest-AttachVolumeNegativeTest-416139458 tempest-AttachVolumeNegativeTest-416139458-project-member] Lock "e1dcf028-0a0b-4b9d-b654-40f7627ebd36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.278s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:15 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399740.773777, ed13cfeb-933e-4cff-804a-f7404df7f2b0 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:29:15 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] VM Stopped (Lifecycle Event)
Apr 13 15:29:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fcdeed0f-f8fc-4b6d-b3c2-30fe71b9d6a5 None None] [instance: ed13cfeb-933e-4cff-804a-f7404df7f2b0] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:29:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:29:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:29:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:29:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:22 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399747.7122855, 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:29:22 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] VM Stopped (Lifecycle Event)
Apr 13 15:29:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-14e545c5-f812-4a10-8174-b8f4d21154ac None None] [instance: 8d3c6ee9-c944-43ed-8d07-2b3eee9dc56b] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:29:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:23 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:29:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:29:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:29:23 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:29:24 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updating instance_info_cache with network_info: [{"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:29:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:29:26 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399751.1360521, e1dcf028-0a0b-4b9d-b654-40f7627ebd36 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:29:26 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] VM Stopped (Lifecycle Event)
Apr 13 15:29:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1321ef03-b8e9-45f4-b05d-39874db258e5 None None] [instance: e1dcf028-0a0b-4b9d-b654-40f7627ebd36] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:29:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:35 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:29:35 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8222MB free_disk=26.099830627441406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 42464137-e247-4191-8ed4-4bbdbe392f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 4211d816-b8aa-452e-9587-bf131e42d643 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:29:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:37 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:37 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:37 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:29:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:43 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:29:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-changed-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Refreshing instance network info cache due to event network-changed-018bebd6-4323-4f9d-8c6d-6da9a7934a97. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:29:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] Acquiring lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:29:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] Acquired lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:29:49 user nova-compute[71507]: DEBUG nova.network.neutron [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Refreshing network info cache for port 018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:29:49 user nova-compute[71507]: DEBUG nova.network.neutron [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updated VIF entry in instance network info cache for port 018bebd6-4323-4f9d-8c6d-6da9a7934a97. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:29:49 user nova-compute[71507]: DEBUG nova.network.neutron [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updating instance_info_cache with network_info: [{"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-06b14eee-c068-4f81-820a-4ff0851c6c0e req-23f05be0-dca1-4575-8aa4-ec08d98bea42 service nova] Releasing lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:29:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Stashing vm_state: active {{(pid=71507) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 15:29:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:50 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'pci_requests' on Instance uuid 4211d816-b8aa-452e-9587-bf131e42d643 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:29:50 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:29:50 user nova-compute[71507]: INFO nova.compute.claims [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Claim successful on node user
Apr 13 15:29:50 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'resources' on Instance uuid 4211d816-b8aa-452e-9587-bf131e42d643 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:29:50 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'pci_devices' on Instance uuid 4211d816-b8aa-452e-9587-bf131e42d643 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:29:50 user nova-compute[71507]: INFO nova.compute.resource_tracker [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating resource usage from migration 7a17feb4-e39a-4dc4-baf4-2dcfbd44693e
Apr 13 15:29:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.373s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:51 user nova-compute[71507]: INFO nova.compute.manager [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Migrating
Apr 13 15:29:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-changed-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Refreshing instance network info cache due to event network-changed-e42a12d0-d042-4277-83a6-7141c1df1ea2. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] Acquiring lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating instance_info_cache with network_info: [{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] Acquired lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:29:51 user nova-compute[71507]: DEBUG nova.network.neutron [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Refreshing network info cache for port e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Starting migrate_disk_and_power_off {{(pid=71507) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-unplugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] No waiting events found dispatching network-vif-unplugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:52 user nova-compute[71507]: WARNING nova.compute.manager [req-f18aff3b-5f65-40a2-bc10-4061d554e020 req-1572734e-d0b8-4e29-b94b-b53815b15eeb service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received unexpected event network-vif-unplugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance with vm_state active and task_state resize_migrating.
Apr 13 15:29:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG nova.network.neutron [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updated VIF entry in instance network info cache for port e42a12d0-d042-4277-83a6-7141c1df1ea2. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG nova.network.neutron [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating instance_info_cache with network_info: [{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a3708ac2-a359-49e0-8da6-23ed78f7cb05 req-5d181cab-6025-413f-a2fd-de60259904bd service nova] Releasing lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:29:52 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Instance destroyed successfully.
Apr 13 15:29:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-243297081',display_name='tempest-ServerActionsTestJSON-server-243297081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-243297081',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-c36rb19c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=4211d816-b8aa-452e-9587-bf131e42d643,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:9f:e0:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:9f:e0:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_vif [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape42a12d0-d0, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:52 user nova-compute[71507]: INFO os_vif [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0')
Apr 13 15:29:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRynUupX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:29:52 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84ec750-76a5-48a2-b428-5ab703d43b02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:29:52 user nova-compute[71507]: No targets found.
Apr 13 15:29:52 user nova-compute[71507]: iSNS:
Apr 13 15:29:52 user nova-compute[71507]: No targets found.
Apr 13 15:29:52 user nova-compute[71507]: STATIC:
Apr 13 15:29:52 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002
Apr 13 15:29:52 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:29:52 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:29:52 user nova-compute[71507]: FIRMWARE:
Apr 13 15:29:52 user nova-compute[71507]: No targets found.
Apr 13 15:29:52 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:29:52 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:29:52 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bd32d6-462c-4013-bb7e-20d047da8dcf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c14c9d-2fc8-4d6a-8dab-4eb1616afcec]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:29:52 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:29:52 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab26820ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d9e3b0-2f0f-41c2-9a1c-8a7300d7f6ec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b1c152-4ac3-486b-8865-77d8a064f9e1]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c125e3-e24f-44e2-aa5c-c2799b138ba6]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:29:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[217facb5-87d2-4256-98fa-4fb4868ea667]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26636636233393263', '/dev/disk/by-id/scsi-1SCST_BIOfea5e64b-f6cb392c8af3b9a3', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fea5e64b') {{(pid=81901) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5865aefc-09bb-4df1-ad59-c7db2bcaff65]: (4, None) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab05ee3-fe45-483d-b2ed-812e0abcda23]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff061f59-a405-4604-916d-f02277ef0268]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260]
Apr 13 15:29:53 user nova-compute[71507]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260] successful.
Apr 13 15:29:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cb7d02-4500-431c-97b3-b148f4cc50d4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== disconnect_volume: return (327ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:29:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Port e42a12d0-d042-4277-83a6-7141c1df1ea2 binding to destination host user is already ACTIVE {{(pid=71507) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG nova.compute.manager [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] No waiting events found dispatching network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:54 user nova-compute[71507]: WARNING nova.compute.manager [req-3e6e911a-6b29-492a-bdf6-03a4887c55eb req-f2787528-3ccb-49ed-a0f1-ced1367f2de7 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received unexpected event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance with vm_state active and task_state resize_migrated.
Apr 13 15:29:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:29:54 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating instance_info_cache with network_info: [{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG os_brick.utils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0c735b-660e-4d76-ba2d-bae57ef4e0e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc31e8f0-8006-4650-a401-467f409b9d0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4410dbb6-cccc-47d7-b5e8-b0d5b1cc06e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f5b0d-f02f-48c3-8f5e-807b94843c68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:29:55 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba014a3-0759-49cb-a8d7-20e38aa74c3b]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG os_brick.utils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:55 user nova-compute[71507]: INFO nova.compute.manager [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Terminating instance
Apr 13 15:29:55 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received event network-vif-unplugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] No waiting events found dispatching network-vif-unplugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-091ec342-08cc-464c-b0c9-11c4f316544d req-ede0d910-78c3-4853-a9e5-249e986334e6 service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received event network-vif-unplugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received event network-changed-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Refreshing instance network info cache due to event network-changed-2fcc3406-d672-49a1-85b8-5f2ce187b541. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] Acquiring lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] Acquired lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Refreshing network info cache for port 2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:29:56 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Instance destroyed successfully.
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lazy-loading 'resources' on Instance uuid 42464137-e247-4191-8ed4-4bbdbe392f95 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-220855040',display_name='tempest-TestStampPattern-server-220855040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-220855040',id=29,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAksZCequnPeyEoxbRX4FTqaIZECithWpaNGXiycVZEBPtiDQC3OzUbnYo2ImPDa8dvWI39XTOjrHTgd99yZNpia3NMbHa+IllMmi0NURtQ7qbFcLr5JTdfFUpnNv2P7uA==',key_name='tempest-TestStampPattern-1982719940',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:23:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='318b9e0eb6a745df811d1daa4d6195fc',ramdisk_id='',reservation_id='r-kajdv5k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1572934421',owner_user_name='tempest-TestStampPattern-1572934421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:26:04Z,user_data=None,user_id='78e289648c244c77ab9ca48154da3cde',uuid=42464137-e247-4191-8ed4-4bbdbe392f95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converting VIF {"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fcc3406-d672-49a1-85b8-5f2ce187b541,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fcc3406-d6') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG os_vif [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fcc3406-d672-49a1-85b8-5f2ce187b541,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fcc3406-d6') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fcc3406-d6, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:29:56 user nova-compute[71507]: INFO os_vif [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:9a:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fcc3406-d672-49a1-85b8-5f2ce187b541,network=Network(b494185f-1f0c-4027-8633-d536f480c6d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fcc3406-d6')
Apr 13 15:29:56 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Deleting instance files /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95_del
Apr 13 15:29:56 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Deletion of /opt/stack/data/nova/instances/42464137-e247-4191-8ed4-4bbdbe392f95_del complete
Apr 13 15:29:56 user nova-compute[71507]: INFO nova.compute.manager [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 15:29:56 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updated VIF entry in instance network info cache for port 2fcc3406-d672-49a1-85b8-5f2ce187b541. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updating instance_info_cache with network_info: [{"id": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "address": "fa:16:3e:a6:9a:cd", "network": {"id": "b494185f-1f0c-4027-8633-d536f480c6d6", "bridge": "br-int", "label": "tempest-TestStampPattern-1665946372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "318b9e0eb6a745df811d1daa4d6195fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fcc3406-d6", "ovs_interfaceid": "2fcc3406-d672-49a1-85b8-5f2ce187b541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ccde476d-cd91-4ede-8f79-d452733c7cd2 req-e6ab7523-9baf-496f-ad6e-4563d5099f2e service nova] Releasing lock "refresh_cache-42464137-e247-4191-8ed4-4bbdbe392f95" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:29:57 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:29:57 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Took 0.53 seconds to deallocate network for instance.
Apr 13 15:29:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:57 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:29:57 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:29:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:57 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Deleted allocations for instance 42464137-e247-4191-8ed4-4bbdbe392f95
Apr 13 15:29:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7fcd66e3-e522-428a-b91c-085b7fcfb9c8 tempest-TestStampPattern-1572934421 tempest-TestStampPattern-1572934421-project-member] Lock "42464137-e247-4191-8ed4-4bbdbe392f95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.905s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received event network-vif-plugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] Acquiring lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] Lock "42464137-e247-4191-8ed4-4bbdbe392f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] No waiting events found dispatching network-vif-plugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:29:58 user nova-compute[71507]: WARNING nova.compute.manager [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received unexpected event network-vif-plugged-2fcc3406-d672-49a1-85b8-5f2ce187b541 for instance with vm_state deleted and task_state None.
Apr 13 15:29:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-a6f417da-c556-4896-967c-ef944d24bd6e req-12ef72d5-09e8-4c36-9049-426972414e5d service nova] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Received event network-vif-deleted-2fcc3406-d672-49a1-85b8-5f2ce187b541 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Starting finish_migration {{(pid=71507) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Instance directory exists: not creating {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 15:29:59 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Creating image(s)
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Ensure instance console log exists: /opt/stack/data/nova/instances/4211d816-b8aa-452e-9587-bf131e42d643/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Start _get_guest_xml network_info=[{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:9f:e0:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRynUupX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4211d816-b8aa-452e-9587-bf131e42d643', 'attached_at': '2023-04-13T15:30:00.000000', 'detached_at': '', 'volume_id': '3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'serial': '3ec0bd78-5754-47ac-8a42-bbdd51d2d002'}, 'attachment_id': 'eed14ed8-b3d6-422c-a594-44118d49af24', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:29:59 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:29:59 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4211d816-b8aa-452e-9587-bf131e42d643 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRynUupX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:29:59 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:29:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:29:59 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:29:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:29:59 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6316f78d-d372-449b-aecc-8b7e5c816938]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:29:59 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b163627-a622-4829-b49f-f0ce35c6069a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002] added
Apr 13 15:29:59 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[056f479c-723b-4c62-ae74-ac5fe3db8e6c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:29:59 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d161f1d-6d7b-4e5d-850f-0144a3604d40]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRynUupX {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRynUupX" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1554ef57-4612-48d6-8f17-f7072d060983]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRynUupX'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc27480c-e089-4caf-86c5-09b12d0e38f1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fe3beb-3e48-42a7-a80d-ca80ab01a058]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:30:00 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:30:00 user nova-compute[71507]:  {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:30:00 user nova-compute[71507]: WARNING os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 15:30:00 user nova-compute[71507]: 
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[406e219a-b231-40e2-8041-43eb0c587d16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260]
Apr 13 15:30:00 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260] successful.
Apr 13 15:30:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ab40c-2954-42a5-88ad-81c96df24c2c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc4eaa-a9c7-4ea1-bb55-24e747cad948]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:30:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:30:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc0710b-d977-446a-9787-0c2aad7a8d0c]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:30:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRynUupX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26636636233393263', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636636233393263', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-243297081',display_name='tempest-ServerActionsTestJSON-server-243297081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-243297081',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-c36rb19c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:29:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=4211d816-b8aa-452e-9587-bf131e42d643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:9f:e0:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:9f:e0:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:30:01 user nova-compute[71507]:   <uuid>4211d816-b8aa-452e-9587-bf131e42d643</uuid>
Apr 13 15:30:01 user nova-compute[71507]:   <name>instance-00000024</name>
Apr 13 15:30:01 user nova-compute[71507]:   <memory>196608</memory>
Apr 13 15:30:01 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:30:01 user nova-compute[71507]:   <metadata>
Apr 13 15:30:01 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:30:01 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:30:01 user nova-compute[71507]:       <nova:name>tempest-ServerActionsTestJSON-server-243297081</nova:name>
Apr 13 15:30:01 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:29:59</nova:creationTime>
Apr 13 15:30:01 user nova-compute[71507]:       <nova:flavor name="m1.micro">
Apr 13 15:30:01 user nova-compute[71507]:         <nova:memory>192</nova:memory>
Apr 13 15:30:01 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:30:01 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:30:01 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:30:01 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:30:01 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:30:01 user nova-compute[71507]:       <nova:owner>
Apr 13 15:30:01 user nova-compute[71507]:         <nova:user uuid="3c12c62d4137473596571e523163e718">tempest-ServerActionsTestJSON-423674903-project-member</nova:user>
Apr 13 15:30:01 user nova-compute[71507]:         <nova:project uuid="9154e4239a1a42a3820c27563ba0513f">tempest-ServerActionsTestJSON-423674903</nova:project>
Apr 13 15:30:01 user nova-compute[71507]:       </nova:owner>
Apr 13 15:30:01 user nova-compute[71507]:       <nova:ports>
Apr 13 15:30:01 user nova-compute[71507]:         <nova:port uuid="e42a12d0-d042-4277-83a6-7141c1df1ea2">
Apr 13 15:30:01 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 15:30:01 user nova-compute[71507]:         </nova:port>
Apr 13 15:30:01 user nova-compute[71507]:       </nova:ports>
Apr 13 15:30:01 user nova-compute[71507]:     </nova:instance>
Apr 13 15:30:01 user nova-compute[71507]:   </metadata>
Apr 13 15:30:01 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:30:01 user nova-compute[71507]:     <system>
Apr 13 15:30:01 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:30:01 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:30:01 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:30:01 user nova-compute[71507]:       <entry name="serial">4211d816-b8aa-452e-9587-bf131e42d643</entry>
Apr 13 15:30:01 user nova-compute[71507]:       <entry name="uuid">4211d816-b8aa-452e-9587-bf131e42d643</entry>
Apr 13 15:30:01 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:30:01 user nova-compute[71507]:     </system>
Apr 13 15:30:01 user nova-compute[71507]:   </sysinfo>
Apr 13 15:30:01 user nova-compute[71507]:   <os>
Apr 13 15:30:01 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:30:01 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:30:01 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:30:01 user nova-compute[71507]:   </os>
Apr 13 15:30:01 user nova-compute[71507]:   <features>
Apr 13 15:30:01 user nova-compute[71507]:     <acpi/>
Apr 13 15:30:01 user nova-compute[71507]:     <apic/>
Apr 13 15:30:01 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:30:01 user nova-compute[71507]:   </features>
Apr 13 15:30:01 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:30:01 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:30:01 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:30:01 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:30:01 user nova-compute[71507]:   </clock>
Apr 13 15:30:01 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:30:01 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:30:01 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:30:01 user nova-compute[71507]:   </cpu>
Apr 13 15:30:01 user nova-compute[71507]:   <devices>
Apr 13 15:30:01 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:30:01 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:30:01 user nova-compute[71507]:       <source dev="/dev/sdb"/>
Apr 13 15:30:01 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:30:01 user nova-compute[71507]:       <serial>3ec0bd78-5754-47ac-8a42-bbdd51d2d002</serial>
Apr 13 15:30:01 user nova-compute[71507]:     </disk>
Apr 13 15:30:01 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:30:01 user nova-compute[71507]:       <mac address="fa:16:3e:9f:e0:7d"/>
Apr 13 15:30:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:30:01 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:30:01 user nova-compute[71507]:       <target dev="tape42a12d0-d0"/>
Apr 13 15:30:01 user nova-compute[71507]:     </interface>
Apr 13 15:30:01 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:30:01 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/4211d816-b8aa-452e-9587-bf131e42d643/console.log" append="off"/>
Apr 13 15:30:01 user nova-compute[71507]:     </serial>
Apr 13 15:30:01 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:30:01 user nova-compute[71507]:     <video>
Apr 13 15:30:01 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:30:01 user nova-compute[71507]:     </video>
Apr 13 15:30:01 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:30:01 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:30:01 user nova-compute[71507]:     </rng>
Apr 13 15:30:01 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:30:01 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:30:01 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:30:01 user nova-compute[71507]:     </memballoon>
Apr 13 15:30:01 user nova-compute[71507]:   </devices>
Apr 13 15:30:01 user nova-compute[71507]: </domain>
Apr 13 15:30:01 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-243297081',display_name='tempest-ServerActionsTestJSON-server-243297081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-243297081',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-c36rb19c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:29:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=4211d816-b8aa-452e-9587-bf131e42d643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:9f:e0:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-768069470-network", "vif_mac": "fa:16:3e:9f:e0:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG os_vif [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape42a12d0-d0, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape42a12d0-d0, col_values=(('external_ids', {'iface-id': 'e42a12d0-d042-4277-83a6-7141c1df1ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:e0:7d', 'vm-uuid': '4211d816-b8aa-452e-9587-bf131e42d643'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:01 user nova-compute[71507]: INFO os_vif [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0')
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:30:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] No VIF found with MAC fa:16:3e:9f:e0:7d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:30:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] No waiting events found dispatching network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:30:02 user nova-compute[71507]: WARNING nova.compute.manager [req-c7f16431-d5fb-43a7-8375-5110b7361f66 req-e6dae345-0f94-44b1-b88f-b9fca74bed14 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received unexpected event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance with vm_state active and task_state resize_finish.
Apr 13 15:30:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:30:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:30:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] No waiting events found dispatching network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:30:04 user nova-compute[71507]: WARNING nova.compute.manager [req-bda9a369-d24e-4278-8e55-1c60a5b7c61d req-064a9247-8f05-4e91-b07b-d44bb4318540 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received unexpected event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance with vm_state active and task_state resize_finish.
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.host [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Removed pending event for 4211d816-b8aa-452e-9587-bf131e42d643 due to event {{(pid=71507) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399805.0255263, 4211d816-b8aa-452e-9587-bf131e42d643 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:30:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] VM Resumed (Lifecycle Event)
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:30:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Instance running successfully.
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Failed to set time: agent not configured {{(pid=71507) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9dddc61e-0298-4508-b5a1-0003d1f216f7 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] finish_migration finished successfully. {{(pid=71507) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:30:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399805.0271606, 4211d816-b8aa-452e-9587-bf131e42d643 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:30:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] VM Started (Lifecycle Event)
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:30:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:30:05 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 15:30:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-changed-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:30:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Refreshing instance network info cache due to event network-changed-e2eabaa4-a35d-433f-850e-949af795e7ed. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:30:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] Acquiring lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:30:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] Acquired lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:30:06 user nova-compute[71507]: DEBUG nova.network.neutron [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Refreshing network info cache for port e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:30:07 user nova-compute[71507]: DEBUG nova.network.neutron [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updated VIF entry in instance network info cache for port e2eabaa4-a35d-433f-850e-949af795e7ed. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:30:07 user nova-compute[71507]: DEBUG nova.network.neutron [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating instance_info_cache with network_info: [{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:30:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4ccf45e6-cb89-46fd-b01b-1edb3ce710f6 req-7d14cca1-3f43-427d-831a-6de042573be3 service nova] Releasing lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:30:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:08 user nova-compute[71507]: INFO nova.compute.manager [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Shelving
Apr 13 15:30:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-unplugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:30:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:30:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] No waiting events found dispatching network-vif-unplugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:30:09 user nova-compute[71507]: WARNING nova.compute.manager [req-2bbf3c37-f834-49b0-872d-32aa38afdae2 req-f2a74b66-706b-4570-bb2b-4dff1167a4c1 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received unexpected event network-vif-unplugged-e2eabaa4-a35d-433f-850e-949af795e7ed for instance with vm_state active and task_state shelving.
Apr 13 15:30:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance destroyed successfully.
Apr 13 15:30:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Beginning cold snapshot process
Apr 13 15:30:10 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:30:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk /opt/stack/data/nova/instances/snapshots/tmp_1j_4obl/facabb88656c474f959b29f9b5d51925 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk /opt/stack/data/nova/instances/snapshots/tmp_1j_4obl/facabb88656c474f959b29f9b5d51925" returned: 0 in 0.472s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:10 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Snapshot extracted, beginning image upload
Apr 13 15:30:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:30:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:30:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] No waiting events found dispatching network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:30:11 user nova-compute[71507]: WARNING nova.compute.manager [req-a586d3bb-87d4-4567-bdc9-15abbf5bd12a req-29a8bd19-b8c4-4cd5-aa56-b1ba57fad2fb service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received unexpected event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 15:30:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:11 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399796.7052257, 42464137-e247-4191-8ed4-4bbdbe392f95 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:30:11 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] VM Stopped (Lifecycle Event)
Apr 13 15:30:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2664c080-b7b4-49df-94bd-d8b191e9024c None None] [instance: 42464137-e247-4191-8ed4-4bbdbe392f95] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:30:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Snapshot image upload complete
Apr 13 15:30:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:30:13 user nova-compute[71507]: INFO nova.compute.manager [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Shelve offloading
Apr 13 15:30:13 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance destroyed successfully.
Apr 13 15:30:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:30:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:30:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquired lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:30:13 user nova-compute[71507]: DEBUG nova.network.neutron [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:30:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:13 user nova-compute[71507]: DEBUG nova.network.neutron [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating instance_info_cache with network_info: [{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:30:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Releasing lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:30:14 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance destroyed successfully.
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.objects.instance [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'resources' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-685773624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-685773624',id=37,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwAMm4sU/Gj3Vzrh3VZEg6lMGBJZ4u46yLNWpEl8KgjKMuyhNTe4lr+wZMx5cIPjHcyJlvVwL2g6JxTANaHJ7wVMvtjiUslCjAeTc41ba0ytt3OvquWPsvKDw4riIwsTg==',key_name='tempest-keypair-1306550106',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:28:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-v5c2531s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member',shelved_at='2023-04-13T15:30:12.951622',shelved_host='user',shelved_image_id='f5d3bf62-9adc-4825-bc86-1764dfbae914'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=9761101e-4bce-4e7b-8137-569bf8d27f87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG os_vif [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2eabaa4-a3, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:30:14 user nova-compute[71507]: INFO os_vif [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3')
Apr 13 15:30:14 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Deleting instance files /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87_del
Apr 13 15:30:14 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Deletion of /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87_del complete
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-changed-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Refreshing instance network info cache due to event network-changed-e2eabaa4-a35d-433f-850e-949af795e7ed. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] Acquiring lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] Acquired lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.network.neutron [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Refreshing network info cache for port e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:30:14 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Deleted allocations for instance 9761101e-4bce-4e7b-8137-569bf8d27f87
Apr 13 15:30:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.objects.instance [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'numa_topology' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-88de4f07-645c-4da5-90de-05437a6ca229 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.590s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.network.neutron [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updated VIF entry in instance network info cache for port e2eabaa4-a35d-433f-850e-949af795e7ed. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG nova.network.neutron [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating instance_info_cache with network_info: [{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:30:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e01fedeb-ccd5-4962-b231-d5e904d30889 req-f720f729-9ffd-4774-a770-a96cbb3e97b5 service nova] Releasing lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:30:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:30:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:30:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:30:24 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399809.779154, 9761101e-4bce-4e7b-8137-569bf8d27f87 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:30:24 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] VM Stopped (Lifecycle Event)
Apr 13 15:30:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1dbec13b-dbed-4f24-8746-5da83d4f6fcd None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:30:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:30:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:30:34 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:30:34 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8400MB free_disk=26.146099090576172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Applying migration context for instance 4211d816-b8aa-452e-9587-bf131e42d643 as it has an incoming, in-progress migration 7a17feb4-e39a-4dc4-baf4-2dcfbd44693e. Migration status is finished {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 15:30:34 user nova-compute[71507]: INFO nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating resource usage from migration 7a17feb4-e39a-4dc4-baf4-2dcfbd44693e
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Migration 7a17feb4-e39a-4dc4-baf4-2dcfbd44693e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 4211d816-b8aa-452e-9587-bf131e42d643 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:30:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:30:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:30:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:30:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:30:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:30:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:30:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:30:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:45 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:30:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:30:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "8082f405-f0bd-4889-ba90-26350f262c4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "8082f405-f0bd-4889-ba90-26350f262c4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:30:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:30:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:30:58 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:30:58 user nova-compute[71507]: INFO nova.compute.claims [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Claim successful on node user
Apr 13 15:30:59 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:30:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:30:59 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:30:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:30:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:30:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:30:59 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:30:59 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:30:59 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:30:59 user nova-compute[71507]: INFO nova.virt.block_device [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Booting with volume snapshot d3d4769d-f892-4cea-b640-216f5f23b184 at /dev/vda
Apr 13 15:30:59 user nova-compute[71507]: DEBUG nova.policy [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:31:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Successfully created port: d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:31:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Successfully updated port: d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:31:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "refresh_cache-8082f405-f0bd-4889-ba90-26350f262c4f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:31:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquired lock "refresh_cache-8082f405-f0bd-4889-ba90-26350f262c4f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:31:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:31:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received event network-changed-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:31:00 user nova-compute[71507]: DEBUG nova.compute.manager [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Refreshing instance network info cache due to event network-changed-d32c2601-e479-49c2-a7bf-4d7bd00138af. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:31:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] Acquiring lock "refresh_cache-8082f405-f0bd-4889-ba90-26350f262c4f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:31:00 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:31:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Updating instance_info_cache with network_info: [{"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:31:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Releasing lock "refresh_cache-8082f405-f0bd-4889-ba90-26350f262c4f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:31:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Instance network_info: |[{"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:31:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] Acquired lock "refresh_cache-8082f405-f0bd-4889-ba90-26350f262c4f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:31:01 user nova-compute[71507]: DEBUG nova.network.neutron [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Refreshing network info cache for port d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:31:01 user nova-compute[71507]: DEBUG nova.network.neutron [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Updated VIF entry in instance network info cache for port d32c2601-e479-49c2-a7bf-4d7bd00138af. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:31:01 user nova-compute[71507]: DEBUG nova.network.neutron [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Updating instance_info_cache with network_info: [{"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:31:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f091bc09-ccad-4cf1-bc28-51532978a8db req-ef7c9fee-05cc-45b4-8c88-2f29becee593 service nova] Releasing lock "refresh_cache-8082f405-f0bd-4889-ba90-26350f262c4f" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:31:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG os_brick.utils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e028e8b0-95a7-452b-a50e-c5ebe1d3ad2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[704f2a3b-4c92-4767-b46e-fe2b0b10721a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd43d9-a470-4d36-a0e8-af049791b279]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d949d686-fffc-4da4-a51b-97d7ec155829]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:31:05 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:31:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7341f2d-391f-4a26-be3b-d695f24fec10]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG os_brick.utils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:31:05 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Updating existing volume attachment record: d0dd85de-26a2-4204-8808-2b947614e901 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:31:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:31:11 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Creating image(s)
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Ensure instance console log exists: /opt/stack/data/nova/instances/8082f405-f0bd-4889-ba90-26350f262c4f/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Start _get_guest_xml network_info=[{"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMlVZBrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8082f405-f0bd-4889-ba90-26350f262c4f', 'attached_at': '', 'detached_at': '', 'volume_id': '689509bb-9dd9-47a2-8381-311283a0f5ad', 'serial': '689509bb-9dd9-47a2-8381-311283a0f5ad'}, 'attachment_id': 'd0dd85de-26a2-4204-8808-2b947614e901', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:31:11 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:31:11 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMlVZBrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:31:11 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:31:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:31:11 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:31:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:31:11 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e60952-2f03-48e8-aab5-8b308a1f16dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:31:11 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9235031d-a758-41cc-963b-4016b030b9a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad] added
Apr 13 15:31:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:31:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f50351-9a9d-4b01-8aa1-b20a8c4bd154]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2fd7e7-2942-42aa-a577-b37b31a3fecf]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMlVZBrj {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMlVZBrj" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ef5f12-64ac-4faf-8703-31610e8ad6e1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uMlVZBrj'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd2d4ec-f88e-47d8-aa44-daff52109996]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef9779c-0b31-4d65-92a2-6667aa4b7ccf]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:31:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:31:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e0a7b-5d62-4b36-8ebb-772c24e57709]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad, portal: 172.16.0.220,3260]
Apr 13 15:31:12 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad, portal: 172.16.0.220,3260] successful.
Apr 13 15:31:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[504ffe3b-db36-439c-b06a-f5e6056a0c97]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e1515-cf5b-445f-9bda-a36fc252abc7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:31:12 user nova-compute[71507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)
Apr 13 15:31:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:31:12 user nova-compute[71507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)
Apr 13 15:31:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8720e20-fc53-4697-b041-2b5e1fb815b2]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:31:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMlVZBrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23265326562383734', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265326562383734', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-784045192',display_name='tempest-TestVolumeBootPattern-server-784045192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-784045192',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-g6d8ogpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:30:59Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=8082f405-f0bd-4889-ba90-26350f262c4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:76:5c,bridge_name='br-int',has_traffic_filtering=True,id=d32c2601-e479-49c2-a7bf-4d7bd00138af,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32c2601-e4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'pci_devices' on Instance uuid 8082f405-f0bd-4889-ba90-26350f262c4f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:31:13 user nova-compute[71507]:   <uuid>8082f405-f0bd-4889-ba90-26350f262c4f</uuid>
Apr 13 15:31:13 user nova-compute[71507]:   <name>instance-00000026</name>
Apr 13 15:31:13 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:31:13 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:31:13 user nova-compute[71507]:   <metadata>
Apr 13 15:31:13 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:31:13 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:31:13 user nova-compute[71507]:       <nova:name>tempest-TestVolumeBootPattern-server-784045192</nova:name>
Apr 13 15:31:13 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:31:11</nova:creationTime>
Apr 13 15:31:13 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:31:13 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:31:13 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:31:13 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:31:13 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:31:13 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:31:13 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:31:13 user nova-compute[71507]:       <nova:owner>
Apr 13 15:31:13 user nova-compute[71507]:         <nova:user uuid="0307fb8d127a41079e34355904352231">tempest-TestVolumeBootPattern-374778702-project-member</nova:user>
Apr 13 15:31:13 user nova-compute[71507]:         <nova:project uuid="d5d7f771264c4cd2bc595a2c525082d0">tempest-TestVolumeBootPattern-374778702</nova:project>
Apr 13 15:31:13 user nova-compute[71507]:       </nova:owner>
Apr 13 15:31:13 user nova-compute[71507]:       <nova:ports>
Apr 13 15:31:13 user nova-compute[71507]:         <nova:port uuid="d32c2601-e479-49c2-a7bf-4d7bd00138af">
Apr 13 15:31:13 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 15:31:13 user nova-compute[71507]:         </nova:port>
Apr 13 15:31:13 user nova-compute[71507]:       </nova:ports>
Apr 13 15:31:13 user nova-compute[71507]:     </nova:instance>
Apr 13 15:31:13 user nova-compute[71507]:   </metadata>
Apr 13 15:31:13 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:31:13 user nova-compute[71507]:     <system>
Apr 13 15:31:13 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:31:13 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:31:13 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:31:13 user nova-compute[71507]:       <entry name="serial">8082f405-f0bd-4889-ba90-26350f262c4f</entry>
Apr 13 15:31:13 user nova-compute[71507]:       <entry name="uuid">8082f405-f0bd-4889-ba90-26350f262c4f</entry>
Apr 13 15:31:13 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:31:13 user nova-compute[71507]:     </system>
Apr 13 15:31:13 user nova-compute[71507]:   </sysinfo>
Apr 13 15:31:13 user nova-compute[71507]:   <os>
Apr 13 15:31:13 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:31:13 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:31:13 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:31:13 user nova-compute[71507]:   </os>
Apr 13 15:31:13 user nova-compute[71507]:   <features>
Apr 13 15:31:13 user nova-compute[71507]:     <acpi/>
Apr 13 15:31:13 user nova-compute[71507]:     <apic/>
Apr 13 15:31:13 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:31:13 user nova-compute[71507]:   </features>
Apr 13 15:31:13 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:31:13 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:31:13 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:31:13 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:31:13 user nova-compute[71507]:   </clock>
Apr 13 15:31:13 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:31:13 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:31:13 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:31:13 user nova-compute[71507]:   </cpu>
Apr 13 15:31:13 user nova-compute[71507]:   <devices>
Apr 13 15:31:13 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:31:13 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:31:13 user nova-compute[71507]:       <source dev="/dev/sdc"/>
Apr 13 15:31:13 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:31:13 user nova-compute[71507]:       <serial>689509bb-9dd9-47a2-8381-311283a0f5ad</serial>
Apr 13 15:31:13 user nova-compute[71507]:     </disk>
Apr 13 15:31:13 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:31:13 user nova-compute[71507]:       <mac address="fa:16:3e:b3:76:5c"/>
Apr 13 15:31:13 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:31:13 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:31:13 user nova-compute[71507]:       <target dev="tapd32c2601-e4"/>
Apr 13 15:31:13 user nova-compute[71507]:     </interface>
Apr 13 15:31:13 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:31:13 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/8082f405-f0bd-4889-ba90-26350f262c4f/console.log" append="off"/>
Apr 13 15:31:13 user nova-compute[71507]:     </serial>
Apr 13 15:31:13 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:31:13 user nova-compute[71507]:     <video>
Apr 13 15:31:13 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:31:13 user nova-compute[71507]:     </video>
Apr 13 15:31:13 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:31:13 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:31:13 user nova-compute[71507]:     </rng>
Apr 13 15:31:13 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:31:13 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:31:13 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:31:13 user nova-compute[71507]:     </memballoon>
Apr 13 15:31:13 user nova-compute[71507]:   </devices>
Apr 13 15:31:13 user nova-compute[71507]: </domain>
Apr 13 15:31:13 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-784045192',display_name='tempest-TestVolumeBootPattern-server-784045192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-784045192',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-g6d8ogpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:30:59Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=8082f405-f0bd-4889-ba90-26350f262c4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:76:5c,bridge_name='br-int',has_traffic_filtering=True,id=d32c2601-e479-49c2-a7bf-4d7bd00138af,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32c2601-e4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG os_vif [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:76:5c,bridge_name='br-int',has_traffic_filtering=True,id=d32c2601-e479-49c2-a7bf-4d7bd00138af,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32c2601-e4') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd32c2601-e4, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd32c2601-e4, col_values=(('external_ids', {'iface-id': 'd32c2601-e479-49c2-a7bf-4d7bd00138af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:76:5c', 'vm-uuid': '8082f405-f0bd-4889-ba90-26350f262c4f'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:13 user nova-compute[71507]: INFO os_vif [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:76:5c,bridge_name='br-int',has_traffic_filtering=True,id=d32c2601-e479-49c2-a7bf-4d7bd00138af,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32c2601-e4')
Apr 13 15:31:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:31:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No VIF found with MAC fa:16:3e:b3:76:5c, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:31:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received event network-vif-plugged-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:31:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] Acquiring lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:31:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:31:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:31:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] No waiting events found dispatching network-vif-plugged-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:31:14 user nova-compute[71507]: WARNING nova.compute.manager [req-568eb2c2-a468-462e-9bd2-6656e12e6fed req-cafa5b83-0eec-4b56-86df-98e8ee003a85 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received unexpected event network-vif-plugged-d32c2601-e479-49c2-a7bf-4d7bd00138af for instance with vm_state building and task_state spawning.
Apr 13 15:31:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399876.7741313, 8082f405-f0bd-4889-ba90-26350f262c4f => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:31:16 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] VM Resumed (Lifecycle Event)
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:31:16 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Instance spawned successfully.
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:31:16 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399876.7763653, 8082f405-f0bd-4889-ba90-26350f262c4f => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:31:16 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] VM Started (Lifecycle Event)
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:31:16 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:31:16 user nova-compute[71507]: INFO nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Took 5.04 seconds to spawn the instance on the hypervisor.
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received event network-vif-plugged-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] Acquiring lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:31:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] No waiting events found dispatching network-vif-plugged-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:31:16 user nova-compute[71507]: WARNING nova.compute.manager [req-12364d1f-e301-41d6-9bfe-e1310742c404 req-6930d3d5-b212-4e90-a0d3-c62d7f56b622 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received unexpected event network-vif-plugged-d32c2601-e479-49c2-a7bf-4d7bd00138af for instance with vm_state building and task_state spawning.
Apr 13 15:31:17 user nova-compute[71507]: INFO nova.compute.manager [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Took 18.15 seconds to build instance.
Apr 13 15:31:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9ba53de8-f275-4f7e-aa5e-1927054b3707 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "8082f405-f0bd-4889-ba90-26350f262c4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.252s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:31:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:31:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:31:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:31:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:31:26 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:31:26 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid 22bb22bd-efa8-4679-979a-dd0ce28a79e3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:31:27 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Updating instance_info_cache with network_info: [{"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:31:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-22bb22bd-efa8-4679-979a-dd0ce28a79e3" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:31:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:31:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:31:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:31:34 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:31:34 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8332MB free_disk=26.133525848388672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Applying migration context for instance 4211d816-b8aa-452e-9587-bf131e42d643 as it has an incoming, in-progress migration 7a17feb4-e39a-4dc4-baf4-2dcfbd44693e. Migration status is finished {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 15:31:34 user nova-compute[71507]: INFO nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating resource usage from migration 7a17feb4-e39a-4dc4-baf4-2dcfbd44693e
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Migration 7a17feb4-e39a-4dc4-baf4-2dcfbd44693e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 4211d816-b8aa-452e-9587-bf131e42d643 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8082f405-f0bd-4889-ba90-26350f262c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:31:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:31:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:39 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:39 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:39 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:31:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:31:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:31:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Going to confirm migration 2 {{(pid=71507) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 13 15:31:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:31:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquired lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:31:40 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:31:40 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'info_cache' on Instance uuid 4211d816-b8aa-452e-9587-bf131e42d643 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:31:41 user nova-compute[71507]: DEBUG nova.network.neutron [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating instance_info_cache with network_info: [{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:31:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Releasing lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:31:41 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'migration_context' on Instance uuid 4211d816-b8aa-452e-9587-bf131e42d643 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:31:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:31:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:31:41 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:31:41 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:31:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.253s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:31:41 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Deleted allocation for migration 7a17feb4-e39a-4dc4-baf4-2dcfbd44693e
Apr 13 15:31:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c9f7b719-8bf1-435d-9398-02bcdefd7d1b tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.144s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:31:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:43 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:46 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:31:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:31:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:31:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:31:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:31:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:31:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:01 user nova-compute[71507]: INFO nova.compute.manager [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Unshelving
Apr 13 15:32:01 user nova-compute[71507]: INFO nova.virt.block_device [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Booting with volume 37b94d35-9939-4ebd-989f-49669dd5ce82 at /dev/vdc
Apr 13 15:32:01 user nova-compute[71507]: DEBUG os_brick.utils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc0e0ec-8051-43e5-966b-1cf0e1b79c53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[040e3e05-bb60-4fe5-b5da-111c31e06b8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7855ab2c-e39e-45fa-9386-222c462d8e64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f0946a-fae5-497d-a41b-d874822cec7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:32:01 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:32:01 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bf300a-b546-44cc-9251-1ebe1330ef15]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG os_brick.utils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:32:01 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating existing volume attachment record: 9b37884f-b291-4107-918c-226b05d1f49c {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:32:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:32:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:05 user nova-compute[71507]: DEBUG nova.objects.instance [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'pci_requests' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:32:05 user nova-compute[71507]: DEBUG nova.objects.instance [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'numa_topology' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:32:05 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:32:05 user nova-compute[71507]: INFO nova.compute.claims [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Claim successful on node user
Apr 13 15:32:06 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:32:06 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:32:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:06 user nova-compute[71507]: INFO nova.network.neutron [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating port e2eabaa4-a35d-433f-850e-949af795e7ed with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 15:32:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:32:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquired lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:32:06 user nova-compute[71507]: DEBUG nova.network.neutron [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:32:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-changed-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:32:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Refreshing instance network info cache due to event network-changed-e2eabaa4-a35d-433f-850e-949af795e7ed. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:32:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] Acquiring lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating instance_info_cache with network_info: [{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Releasing lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:32:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Creating image(s)
Apr 13 15:32:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG nova.objects.instance [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] Acquired lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG nova.network.neutron [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Refreshing network info cache for port e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "2d47881aa93b13f3ef1f3283b23a1cc4c56a870b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "2d47881aa93b13f3ef1f3283b23a1cc4c56a870b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b.part --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG nova.virt.images [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] f5d3bf62-9adc-4825-bc86-1764dfbae914 was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b.part /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b.part /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b.converted" returned: 0 in 0.188s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updated VIF entry in instance network info cache for port e2eabaa4-a35d-433f-850e-949af795e7ed. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating instance_info_cache with network_info: [{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-390f8696-ca85-405f-bc03-8abd00747f19 req-471cfb75-d762-4c6e-85a7-4a28c7cb2275 service nova] Releasing lock "refresh_cache-9761101e-4bce-4e7b-8137-569bf8d27f87" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "2d47881aa93b13f3ef1f3283b23a1cc4c56a870b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.388s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "2d47881aa93b13f3ef1f3283b23a1cc4c56a870b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "2d47881aa93b13f3ef1f3283b23a1cc4c56a870b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:08 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b --force-share --output=json" returned: 0 in 0.127s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b,backing_fmt=raw /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b,backing_fmt=raw /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk 1073741824" returned: 0 in 0.047s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "2d47881aa93b13f3ef1f3283b23a1cc4c56a870b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b --force-share --output=json" returned: 0 in 0.129s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:09 user nova-compute[71507]: DEBUG nova.objects.instance [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'migration_context' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:32:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Rebasing disk image.
Apr 13 15:32:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 -F raw /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 -F raw /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk" returned: 0 in 1.899s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Ensure instance console log exists: /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Start _get_guest_xml network_info=[{"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='91654d3972db7b619683e40218b77a0c',container_format='bare',created_at=2023-04-13T15:30:09Z,direct_url=<?>,disk_format='qcow2',id=f5d3bf62-9adc-4825-bc86-1764dfbae914,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-685773624-shelved',owner='51df4613a6664a0fab857a9a83b6df62',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T15:30:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqiBmWYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '9761101e-4bce-4e7b-8137-569bf8d27f87', 'attached_at': '', 'detached_at': '', 'volume_id': '37b94d35-9939-4ebd-989f-49669dd5ce82', 'serial': '37b94d35-9939-4ebd-989f-49669dd5ce82'}, 'attachment_id': '9b37884f-b291-4107-918c-226b05d1f49c', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:32:11 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:32:11 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='91654d3972db7b619683e40218b77a0c',container_format='bare',created_at=2023-04-13T15:30:09Z,direct_url=<?>,disk_format='qcow2',id=f5d3bf62-9adc-4825-bc86-1764dfbae914,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-685773624-shelved',owner='51df4613a6664a0fab857a9a83b6df62',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T15:30:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqiBmWYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:32:11 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:32:11 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:32:11 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f87fd3b-f6d7-4c6c-bcb3-1c143472a1a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:32:11 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[39952baf-fb78-4c3e-bfb9-50a8ef782706]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82] added
Apr 13 15:32:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23349d6-1c21-47f7-a492-afd1089ebe72]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ad0d6c-96cf-4651-808d-41dd1c104d04]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqiBmWYc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqiBmWYc" returned: 0 in 0.040s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a9dff7-c932-4328-820a-e7290caa0bd7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqiBmWYc'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6db0b5-46dd-40be-96e0-b924d22a9dfe]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[509a9f19-cfd0-4a2c-b3fb-beed67763ac9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:32:11 user nova-compute[71507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)
Apr 13 15:32:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:32:11 user nova-compute[71507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)
Apr 13 15:32:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0571ddd5-ec7e-4cd0-a361-1cf24e61a36a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82, portal: 172.16.0.220,3260]
Apr 13 15:32:11 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82, portal: 172.16.0.220,3260] successful.
Apr 13 15:32:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[00608ffd-1ab3-4dc2-a565-8e8d51cdb319]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3eec51-39de-4405-87ab-adb9df01f495]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:32:11 user nova-compute[71507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)
Apr 13 15:32:11 user nova-compute[71507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 (non-flash)
Apr 13 15:32:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:32:11 user nova-compute[71507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)
Apr 13 15:32:11 user nova-compute[71507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 (non-flash)
Apr 13 15:32:11 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceec2e0d-badc-43b4-8bac-54e4510692f5]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqiBmWYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23733306430616366', 'path': '/dev/sdd'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733306430616366', 'path': '/dev/sdd'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-685773624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-685773624',id=37,image_ref='f5d3bf62-9adc-4825-bc86-1764dfbae914',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1306550106',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:28:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-v5c2531s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member',shelved_at='2023-04-13T15:30:12.951622',shelved_host='user',shelved_image_id='f5d3bf62-9adc-4825-bc86-1764dfbae914'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=9761101e-4bce-4e7b-8137-569bf8d27f87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG nova.objects.instance [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'pci_devices' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:32:12 user nova-compute[71507]:   <uuid>9761101e-4bce-4e7b-8137-569bf8d27f87</uuid>
Apr 13 15:32:12 user nova-compute[71507]:   <name>instance-00000025</name>
Apr 13 15:32:12 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:32:12 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:32:12 user nova-compute[71507]:   <metadata>
Apr 13 15:32:12 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:32:12 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:32:12 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-685773624</nova:name>
Apr 13 15:32:12 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:32:11</nova:creationTime>
Apr 13 15:32:12 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:32:12 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:32:12 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:32:12 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:32:12 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:32:12 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:32:12 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:32:12 user nova-compute[71507]:       <nova:owner>
Apr 13 15:32:12 user nova-compute[71507]:         <nova:user uuid="a0bc1b61d8dc44aa8460fe2cd510c0a4">tempest-AttachVolumeShelveTestJSON-1608248430-project-member</nova:user>
Apr 13 15:32:12 user nova-compute[71507]:         <nova:project uuid="51df4613a6664a0fab857a9a83b6df62">tempest-AttachVolumeShelveTestJSON-1608248430</nova:project>
Apr 13 15:32:12 user nova-compute[71507]:       </nova:owner>
Apr 13 15:32:12 user nova-compute[71507]:       <nova:root type="image" uuid="f5d3bf62-9adc-4825-bc86-1764dfbae914"/>
Apr 13 15:32:12 user nova-compute[71507]:       <nova:ports>
Apr 13 15:32:12 user nova-compute[71507]:         <nova:port uuid="e2eabaa4-a35d-433f-850e-949af795e7ed">
Apr 13 15:32:12 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 15:32:12 user nova-compute[71507]:         </nova:port>
Apr 13 15:32:12 user nova-compute[71507]:       </nova:ports>
Apr 13 15:32:12 user nova-compute[71507]:     </nova:instance>
Apr 13 15:32:12 user nova-compute[71507]:   </metadata>
Apr 13 15:32:12 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:32:12 user nova-compute[71507]:     <system>
Apr 13 15:32:12 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:32:12 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:32:12 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:32:12 user nova-compute[71507]:       <entry name="serial">9761101e-4bce-4e7b-8137-569bf8d27f87</entry>
Apr 13 15:32:12 user nova-compute[71507]:       <entry name="uuid">9761101e-4bce-4e7b-8137-569bf8d27f87</entry>
Apr 13 15:32:12 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:32:12 user nova-compute[71507]:     </system>
Apr 13 15:32:12 user nova-compute[71507]:   </sysinfo>
Apr 13 15:32:12 user nova-compute[71507]:   <os>
Apr 13 15:32:12 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:32:12 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:32:12 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:32:12 user nova-compute[71507]:   </os>
Apr 13 15:32:12 user nova-compute[71507]:   <features>
Apr 13 15:32:12 user nova-compute[71507]:     <acpi/>
Apr 13 15:32:12 user nova-compute[71507]:     <apic/>
Apr 13 15:32:12 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:32:12 user nova-compute[71507]:   </features>
Apr 13 15:32:12 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:32:12 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:32:12 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:32:12 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:32:12 user nova-compute[71507]:   </clock>
Apr 13 15:32:12 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:32:12 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:32:12 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:32:12 user nova-compute[71507]:   </cpu>
Apr 13 15:32:12 user nova-compute[71507]:   <devices>
Apr 13 15:32:12 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:32:12 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:32:12 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk"/>
Apr 13 15:32:12 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:32:12 user nova-compute[71507]:     </disk>
Apr 13 15:32:12 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:32:12 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:32:12 user nova-compute[71507]:       <source dev="/dev/sdd"/>
Apr 13 15:32:12 user nova-compute[71507]:       <target dev="vdc" bus="virtio"/>
Apr 13 15:32:12 user nova-compute[71507]:       <serial>37b94d35-9939-4ebd-989f-49669dd5ce82</serial>
Apr 13 15:32:12 user nova-compute[71507]:     </disk>
Apr 13 15:32:12 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:32:12 user nova-compute[71507]:       <mac address="fa:16:3e:bd:e2:6c"/>
Apr 13 15:32:12 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:32:12 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:32:12 user nova-compute[71507]:       <target dev="tape2eabaa4-a3"/>
Apr 13 15:32:12 user nova-compute[71507]:     </interface>
Apr 13 15:32:12 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:32:12 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/console.log" append="off"/>
Apr 13 15:32:12 user nova-compute[71507]:     </serial>
Apr 13 15:32:12 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:32:12 user nova-compute[71507]:     <video>
Apr 13 15:32:12 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:32:12 user nova-compute[71507]:     </video>
Apr 13 15:32:12 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:32:12 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:32:12 user nova-compute[71507]:     </rng>
Apr 13 15:32:12 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:32:12 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:32:12 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:32:12 user nova-compute[71507]:     </memballoon>
Apr 13 15:32:12 user nova-compute[71507]:   </devices>
Apr 13 15:32:12 user nova-compute[71507]: </domain>
Apr 13 15:32:12 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-685773624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-685773624',id=37,image_ref='f5d3bf62-9adc-4825-bc86-1764dfbae914',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1306550106',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:28:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-v5c2531s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member',shelved_at='2023-04-13T15:30:12.951622',shelved_host='user',shelved_image_id='f5d3bf62-9adc-4825-bc86-1764dfbae914'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=9761101e-4bce-4e7b-8137-569bf8d27f87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG os_vif [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2eabaa4-a3, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2eabaa4-a3, col_values=(('external_ids', {'iface-id': 'e2eabaa4-a35d-433f-850e-949af795e7ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:e2:6c', 'vm-uuid': '9761101e-4bce-4e7b-8137-569bf8d27f87'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:32:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:12 user nova-compute[71507]: INFO os_vif [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3')
Apr 13 15:32:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:32:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:32:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] No VIF found with MAC fa:16:3e:bd:e2:6c, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] No waiting events found dispatching network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:32:14 user nova-compute[71507]: WARNING nova.compute.manager [req-1b675258-d5ab-43cf-a7f8-590e6241d93d req-d301f5e2-4d37-4969-8043-42d188e7d437 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received unexpected event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 15:32:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399936.544103, 9761101e-4bce-4e7b-8137-569bf8d27f87 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:32:16 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] VM Resumed (Lifecycle Event)
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:32:16 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance spawned successfully.
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.compute.manager [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] No waiting events found dispatching network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:32:16 user nova-compute[71507]: WARNING nova.compute.manager [req-f9c3fa73-314f-4083-a49e-64dbc26810b0 req-95d57572-85e3-4285-a144-62da5ae5e31d service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received unexpected event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 15:32:16 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681399936.5461655, 9761101e-4bce-4e7b-8137-569bf8d27f87 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:32:16 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] VM Started (Lifecycle Event)
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:32:16 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:32:16 user nova-compute[71507]: DEBUG nova.compute.manager [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:32:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-483ad3c2-d697-4191-9231-49aced8b93cb tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.701s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:26 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:32:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:32:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:32:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:32:26 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:32:27 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updating instance_info_cache with network_info: [{"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:32:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-58e8e652-d56c-45b6-92ff-a50406ea48e9" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:32:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:32:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:32:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:32:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:32:37 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:32:37 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8260MB free_disk=26.114871978759766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 4211d816-b8aa-452e-9587-bf131e42d643 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 8082f405-f0bd-4889-ba90-26350f262c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:32:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:32:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:32:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:32:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:43 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:32:44 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:32:46 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:32:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "8082f405-f0bd-4889-ba90-26350f262c4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "8082f405-f0bd-4889-ba90-26350f262c4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:49 user nova-compute[71507]: INFO nova.compute.manager [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Terminating instance
Apr 13 15:32:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received event network-vif-unplugged-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] Acquiring lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] No waiting events found dispatching network-vif-unplugged-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-3cc8fab2-1875-41ae-b329-153a4832f9c5 req-8cf96707-829e-4a87-aac3-65452b1ff9c4 service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received event network-vif-unplugged-d32c2601-e479-49c2-a7bf-4d7bd00138af for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:49 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Instance destroyed successfully.
Apr 13 15:32:49 user nova-compute[71507]: DEBUG nova.objects.instance [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'resources' on Instance uuid 8082f405-f0bd-4889-ba90-26350f262c4f {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-784045192',display_name='tempest-TestVolumeBootPattern-server-784045192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-784045192',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:31:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-g6d8ogpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:31:17Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=8082f405-f0bd-4889-ba90-26350f262c4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "address": "fa:16:3e:b3:76:5c", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd32c2601-e4", "ovs_interfaceid": "d32c2601-e479-49c2-a7bf-4d7bd00138af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:76:5c,bridge_name='br-int',has_traffic_filtering=True,id=d32c2601-e479-49c2-a7bf-4d7bd00138af,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32c2601-e4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG os_vif [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:76:5c,bridge_name='br-int',has_traffic_filtering=True,id=d32c2601-e479-49c2-a7bf-4d7bd00138af,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32c2601-e4') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd32c2601-e4, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:32:49 user nova-compute[71507]: INFO os_vif [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:76:5c,bridge_name='br-int',has_traffic_filtering=True,id=d32c2601-e479-49c2-a7bf-4d7bd00138af,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd32c2601-e4')
Apr 13 15:32:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMlVZBrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:32:49 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:32:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f373b96-6aa9-47d4-b19e-4b95e6cdbc3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:32:49 user nova-compute[71507]: No targets found.
Apr 13 15:32:49 user nova-compute[71507]: iSNS:
Apr 13 15:32:49 user nova-compute[71507]: No targets found.
Apr 13 15:32:49 user nova-compute[71507]: STATIC:
Apr 13 15:32:49 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002
Apr 13 15:32:49 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:32:49 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:32:49 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad
Apr 13 15:32:49 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:32:49 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:32:49 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82
Apr 13 15:32:49 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:32:49 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:32:49 user nova-compute[71507]: FIRMWARE:
Apr 13 15:32:49 user nova-compute[71507]: No targets found.
Apr 13 15:32:49 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:32:49 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:32:49 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:32:49 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[732eeedd-6b12-4fcb-9311-9f28047ac528]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6911cdd-31ab-4996-8b82-132cdb6dbdbc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:32:50 user nova-compute[71507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)
Apr 13 15:32:50 user nova-compute[71507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 (non-flash)
Apr 13 15:32:50 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:32:50 user nova-compute[71507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad (non-flash)
Apr 13 15:32:50 user nova-compute[71507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 (non-flash)
Apr 13 15:32:50 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c643250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe0ddc1-e67a-4b21-9913-1f4ee6f03ec9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a7ee48-7fee-40cc-802c-43f18dc265a4]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[519d98b1-4d91-4f1d-957e-991f837e4ecf]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f90270-7fd8-4397-9888-29da9c2d7c2f]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[580cd214-c27e-4751-8630-d96925139c6c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b216db9-3c60-4c79-8b36-7a753d3ac59d]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad, portal: 172.16.0.220,3260]
Apr 13 15:32:50 user nova-compute[71507]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad, portal: 172.16.0.220,3260] successful.
Apr 13 15:32:50 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689509bb-9dd9-47a2-8381-311283a0f5ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc69c455-bd1c-4a90-82bd-3557099be2c8]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== disconnect_volume: return (310ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:32:50 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Deleting instance files /opt/stack/data/nova/instances/8082f405-f0bd-4889-ba90-26350f262c4f_del
Apr 13 15:32:50 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Deletion of /opt/stack/data/nova/instances/8082f405-f0bd-4889-ba90-26350f262c4f_del complete
Apr 13 15:32:50 user nova-compute[71507]: INFO nova.compute.manager [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 13 15:32:50 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:32:50 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:32:50 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Took 0.55 seconds to deallocate network for instance.
Apr 13 15:32:50 user nova-compute[71507]: DEBUG nova.compute.manager [req-7a3961e7-667b-4bf6-971b-c94dda8f5711 req-a5b64d7c-c4fe-45fd-9825-996127873b3e service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received event network-vif-deleted-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received event network-vif-plugged-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] Acquiring lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] Lock "8082f405-f0bd-4889-ba90-26350f262c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] No waiting events found dispatching network-vif-plugged-d32c2601-e479-49c2-a7bf-4d7bd00138af {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:32:51 user nova-compute[71507]: WARNING nova.compute.manager [req-68fb1a89-3d2c-4558-a717-9406c285e2fd req-917b7550-3888-4252-b1bc-27291b7faf8d service nova] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Received unexpected event network-vif-plugged-d32c2601-e479-49c2-a7bf-4d7bd00138af for instance with vm_state active and task_state deleting.
Apr 13 15:32:51 user nova-compute[71507]: INFO nova.compute.manager [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Took 0.75 seconds to detach 1 volumes for instance.
Apr 13 15:32:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Deleting volume: 689509bb-9dd9-47a2-8381-311283a0f5ad {{(pid=71507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:32:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:52 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Deleted allocations for instance 8082f405-f0bd-4889-ba90-26350f262c4f
Apr 13 15:32:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-32e03b2c-65a2-42fe-8ba0-7a64802e67f7 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "8082f405-f0bd-4889-ba90-26350f262c4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.909s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:32:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:32:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:04 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681399969.9210634, 8082f405-f0bd-4889-ba90-26350f262c4f => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:33:04 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] VM Stopped (Lifecycle Event)
Apr 13 15:33:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2ca29825-071b-446a-9936-113e20e77500 None None] [instance: 8082f405-f0bd-4889-ba90-26350f262c4f] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:33:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:33:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:33:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:33:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:33:27 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:33:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:33:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:33:27 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:33:28 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating instance_info_cache with network_info: [{"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:33:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-4211d816-b8aa-452e-9587-bf131e42d643" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:33:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:33:29 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:29 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances with incomplete migration  {{(pid=71507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 15:33:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:33:31 user nova-compute[71507]: INFO nova.compute.manager [None req-940cf3a8-6abc-4daf-a82f-5f4e8e33c141 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Get console output
Apr 13 15:33:31 user nova-compute[71507]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 13 15:33:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 15:33:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] There are 0 instances to clean {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 15:33:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:33:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:33:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:33:36 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:33:36 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8424MB free_disk=26.113811492919922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:33:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 4211d816-b8aa-452e-9587-bf131e42d643 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing inventories for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating ProviderTree inventory for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing aggregate associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, aggregates: None {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing trait associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:33:37 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:33:43 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:33:46 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:46 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "362ab343-a3a0-46e0-a0a7-c25e60133227" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:33:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:33:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:33:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:33:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:33:47 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:33:47 user nova-compute[71507]: INFO nova.compute.claims [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Claim successful on node user
Apr 13 15:33:48 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:33:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:33:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:33:48 user nova-compute[71507]: INFO nova.virt.block_device [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Booting with volume 662f5cd6-04ae-41af-8266-365985d19beb at /dev/vda
Apr 13 15:33:48 user nova-compute[71507]: DEBUG os_brick.utils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f888ee-9e1e-4097-84e5-59dd6ea91096]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG nova.policy [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[376919a0-22c7-421d-a242-079607e27617]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a55434-3ffb-4ccd-826d-d4b426ec6929]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74158f7-0eec-44ec-90bd-1779fe92e42d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:33:48 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94817da-c6c5-4a5e-b219-103002b2638c]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG os_brick.utils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Updating existing volume attachment record: 9f6b98c3-8c66-4796-ac0f-015ede55020e {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Successfully created port: b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Successfully updated port: b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquired lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received event network-changed-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Refreshing instance network info cache due to event network-changed-b70334b8-70db-4e5e-b2c9-11b514210eef. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] Acquiring lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:33:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:50 user nova-compute[71507]: DEBUG nova.network.neutron [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Updating instance_info_cache with network_info: [{"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:33:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Releasing lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:33:50 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Instance network_info: |[{"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:33:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] Acquired lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:33:50 user nova-compute[71507]: DEBUG nova.network.neutron [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Refreshing network info cache for port b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:33:50 user nova-compute[71507]: DEBUG nova.network.neutron [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Updated VIF entry in instance network info cache for port b70334b8-70db-4e5e-b2c9-11b514210eef. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:33:50 user nova-compute[71507]: DEBUG nova.network.neutron [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Updating instance_info_cache with network_info: [{"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:33:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3a00f2ac-dd14-408b-bdfc-a0603f692714 req-0a1497d9-c221-43a5-832b-1051183ca6a5 service nova] Releasing lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:33:51 user nova-compute[71507]: INFO nova.compute.manager [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Detaching volume 37b94d35-9939-4ebd-989f-49669dd5ce82
Apr 13 15:33:51 user nova-compute[71507]: INFO nova.virt.block_device [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Attempting to driver detach volume 37b94d35-9939-4ebd-989f-49669dd5ce82 from mountpoint /dev/vdc
Apr 13 15:33:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Attempting to detach device vdc from instance 9761101e-4bce-4e7b-8137-569bf8d27f87 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:33:51 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:33:51 user nova-compute[71507]:   <source dev="/dev/sdd"/>
Apr 13 15:33:51 user nova-compute[71507]:   <target dev="vdc" bus="virtio"/>
Apr 13 15:33:51 user nova-compute[71507]:   <serial>37b94d35-9939-4ebd-989f-49669dd5ce82</serial>
Apr 13 15:33:51 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 15:33:51 user nova-compute[71507]: </disk>
Apr 13 15:33:51 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:33:51 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully detached device vdc from instance 9761101e-4bce-4e7b-8137-569bf8d27f87 from the persistent domain config.
Apr 13 15:33:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9761101e-4bce-4e7b-8137-569bf8d27f87 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:33:51 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:33:51 user nova-compute[71507]:   <source dev="/dev/sdd"/>
Apr 13 15:33:51 user nova-compute[71507]:   <target dev="vdc" bus="virtio"/>
Apr 13 15:33:51 user nova-compute[71507]:   <serial>37b94d35-9939-4ebd-989f-49669dd5ce82</serial>
Apr 13 15:33:51 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 15:33:51 user nova-compute[71507]: </disk>
Apr 13 15:33:51 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681400031.8757873, 9761101e-4bce-4e7b-8137-569bf8d27f87 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:33:51 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully detached device vdc from instance 9761101e-4bce-4e7b-8137-569bf8d27f87 from the live domain config.
Apr 13 15:33:51 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqiBmWYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:33:51 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd0bc2-b5a6-4335-ace9-ad89b1a5689f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:33:51 user nova-compute[71507]: No targets found.
Apr 13 15:33:51 user nova-compute[71507]: iSNS:
Apr 13 15:33:51 user nova-compute[71507]: No targets found.
Apr 13 15:33:51 user nova-compute[71507]: STATIC:
Apr 13 15:33:51 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002
Apr 13 15:33:51 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:33:51 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:33:51 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82
Apr 13 15:33:51 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:33:51 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:33:51 user nova-compute[71507]: FIRMWARE:
Apr 13 15:33:51 user nova-compute[71507]: No targets found.
Apr 13 15:33:51 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:33:51 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:33:51 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8f9dd1-253f-4648-9ef9-80b68ac0372c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[37636eca-26be-4a02-b71d-4af57f905573]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:33:51 user nova-compute[71507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 (non-flash)
Apr 13 15:33:51 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:33:51 user nova-compute[71507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 (non-flash)
Apr 13 15:33:51 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1422f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82'): ({'sdd'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Removing single pathed devices sdd {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b414720-584d-4369-8eea-4204557f55fc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8086840-b8f9-454e-b892-7306efce707d]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flushing IO for device /dev/sdd {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4234cd3f-95f8-4316-a668-9315ae36d06d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[197ef883-9cd9-424a-88f5-eee8b966f8f0]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] SCSI volumes sdd have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ab3b62-7ad5-4550-b69f-b5865944c689]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd64dfdc-38eb-49ce-a858-dda0c2d27445]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82, portal: 172.16.0.220,3260]
Apr 13 15:33:52 user nova-compute[71507]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82, portal: 172.16.0.220,3260] successful.
Apr 13 15:33:52 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b94d35-9939-4ebd-989f-49669dd5ce82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c6263-9732-4cd2-b4ea-1c3a038434ed]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] <== disconnect_volume: return (299ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:33:52 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Creating image(s)
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Ensure instance console log exists: /opt/stack/data/nova/instances/362ab343-a3a0-46e0-a0a7-c25e60133227/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Start _get_guest_xml network_info=[{"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuFlTvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '362ab343-a3a0-46e0-a0a7-c25e60133227', 'attached_at': '', 'detached_at': '', 'volume_id': '662f5cd6-04ae-41af-8266-365985d19beb', 'serial': '662f5cd6-04ae-41af-8266-365985d19beb'}, 'attachment_id': '9f6b98c3-8c66-4796-ac0f-015ede55020e', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:33:52 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:33:52 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuFlTvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:33:52 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:33:52 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:33:52 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:33:52 user nova-compute[71507]: DEBUG nova.objects.instance [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'flavor' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be9ff13-e286-490d-b947-7c4367e9e3bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:33:52 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:52 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3647117-fca7-4f3d-8b50-6ff70b6c7706]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb] added
Apr 13 15:33:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-1d4a6891-6472-4744-b9d6-36fb3431266e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a649fd6-9ca0-44a9-a184-bbbc3297b084]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c8c2da-2e20-48fd-9b2a-e4a9a51ac0e4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuFlTvYr {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuFlTvYr" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa3951e-9bd2-4f6d-b973-f9833c5495fd]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QuFlTvYr'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ee3d1-40e7-4f5b-bfc8-6a6cc4d7c497]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b685774-af32-4cf7-bd43-91af674e1d1a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:33:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:33:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2d9ac-711b-4773-9f55-7e384d941ee8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb, portal: 172.16.0.220,3260]
Apr 13 15:33:53 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb, portal: 172.16.0.220,3260] successful.
Apr 13 15:33:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d42513-1e8a-4eb4-9d9e-f9a9b0b75682]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1b80d4-2e07-41bb-9980-7f02825e4d0f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:33:53 user nova-compute[71507]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:33:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:33:53 user nova-compute[71507]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:33:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[343677c4-a0b0-45eb-b2c2-65f9336d9a7b]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:33:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuFlTvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23534306431653730', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534306431653730', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2134972973',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2134972973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2134972973',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-lxogsjd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:33:48Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=362ab343-a3a0-46e0-a0a7-c25e60133227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:80:ee,bridge_name='br-int',has_traffic_filtering=True,id=b70334b8-70db-4e5e-b2c9-11b514210eef,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70334b8-70') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'pci_devices' on Instance uuid 362ab343-a3a0-46e0-a0a7-c25e60133227 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:33:54 user nova-compute[71507]:   <uuid>362ab343-a3a0-46e0-a0a7-c25e60133227</uuid>
Apr 13 15:33:54 user nova-compute[71507]:   <name>instance-00000027</name>
Apr 13 15:33:54 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:33:54 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:33:54 user nova-compute[71507]:   <metadata>
Apr 13 15:33:54 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:33:54 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:33:54 user nova-compute[71507]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2134972973</nova:name>
Apr 13 15:33:54 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:33:52</nova:creationTime>
Apr 13 15:33:54 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:33:54 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:33:54 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:33:54 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:33:54 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:33:54 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:33:54 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:33:54 user nova-compute[71507]:       <nova:owner>
Apr 13 15:33:54 user nova-compute[71507]:         <nova:user uuid="0307fb8d127a41079e34355904352231">tempest-TestVolumeBootPattern-374778702-project-member</nova:user>
Apr 13 15:33:54 user nova-compute[71507]:         <nova:project uuid="d5d7f771264c4cd2bc595a2c525082d0">tempest-TestVolumeBootPattern-374778702</nova:project>
Apr 13 15:33:54 user nova-compute[71507]:       </nova:owner>
Apr 13 15:33:54 user nova-compute[71507]:       <nova:ports>
Apr 13 15:33:54 user nova-compute[71507]:         <nova:port uuid="b70334b8-70db-4e5e-b2c9-11b514210eef">
Apr 13 15:33:54 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:33:54 user nova-compute[71507]:         </nova:port>
Apr 13 15:33:54 user nova-compute[71507]:       </nova:ports>
Apr 13 15:33:54 user nova-compute[71507]:     </nova:instance>
Apr 13 15:33:54 user nova-compute[71507]:   </metadata>
Apr 13 15:33:54 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:33:54 user nova-compute[71507]:     <system>
Apr 13 15:33:54 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:33:54 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:33:54 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:33:54 user nova-compute[71507]:       <entry name="serial">362ab343-a3a0-46e0-a0a7-c25e60133227</entry>
Apr 13 15:33:54 user nova-compute[71507]:       <entry name="uuid">362ab343-a3a0-46e0-a0a7-c25e60133227</entry>
Apr 13 15:33:54 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:33:54 user nova-compute[71507]:     </system>
Apr 13 15:33:54 user nova-compute[71507]:   </sysinfo>
Apr 13 15:33:54 user nova-compute[71507]:   <os>
Apr 13 15:33:54 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:33:54 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:33:54 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:33:54 user nova-compute[71507]:   </os>
Apr 13 15:33:54 user nova-compute[71507]:   <features>
Apr 13 15:33:54 user nova-compute[71507]:     <acpi/>
Apr 13 15:33:54 user nova-compute[71507]:     <apic/>
Apr 13 15:33:54 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:33:54 user nova-compute[71507]:   </features>
Apr 13 15:33:54 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:33:54 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:33:54 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:33:54 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:33:54 user nova-compute[71507]:   </clock>
Apr 13 15:33:54 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:33:54 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:33:54 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:33:54 user nova-compute[71507]:   </cpu>
Apr 13 15:33:54 user nova-compute[71507]:   <devices>
Apr 13 15:33:54 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:33:54 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:33:54 user nova-compute[71507]:       <source dev="/dev/sdc"/>
Apr 13 15:33:54 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:33:54 user nova-compute[71507]:       <serial>662f5cd6-04ae-41af-8266-365985d19beb</serial>
Apr 13 15:33:54 user nova-compute[71507]:     </disk>
Apr 13 15:33:54 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:33:54 user nova-compute[71507]:       <mac address="fa:16:3e:0d:80:ee"/>
Apr 13 15:33:54 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:33:54 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:33:54 user nova-compute[71507]:       <target dev="tapb70334b8-70"/>
Apr 13 15:33:54 user nova-compute[71507]:     </interface>
Apr 13 15:33:54 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:33:54 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/362ab343-a3a0-46e0-a0a7-c25e60133227/console.log" append="off"/>
Apr 13 15:33:54 user nova-compute[71507]:     </serial>
Apr 13 15:33:54 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:33:54 user nova-compute[71507]:     <video>
Apr 13 15:33:54 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:33:54 user nova-compute[71507]:     </video>
Apr 13 15:33:54 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:33:54 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:33:54 user nova-compute[71507]:     </rng>
Apr 13 15:33:54 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:33:54 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:33:54 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:33:54 user nova-compute[71507]:     </memballoon>
Apr 13 15:33:54 user nova-compute[71507]:   </devices>
Apr 13 15:33:54 user nova-compute[71507]: </domain>
Apr 13 15:33:54 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2134972973',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2134972973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2134972973',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-lxogsjd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:33:48Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=362ab343-a3a0-46e0-a0a7-c25e60133227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:80:ee,bridge_name='br-int',has_traffic_filtering=True,id=b70334b8-70db-4e5e-b2c9-11b514210eef,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70334b8-70') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG os_vif [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:80:ee,bridge_name='br-int',has_traffic_filtering=True,id=b70334b8-70db-4e5e-b2c9-11b514210eef,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70334b8-70') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb70334b8-70, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb70334b8-70, col_values=(('external_ids', {'iface-id': 'b70334b8-70db-4e5e-b2c9-11b514210eef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:80:ee', 'vm-uuid': '362ab343-a3a0-46e0-a0a7-c25e60133227'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:54 user nova-compute[71507]: INFO os_vif [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:80:ee,bridge_name='br-int',has_traffic_filtering=True,id=b70334b8-70db-4e5e-b2c9-11b514210eef,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70334b8-70')
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:33:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No VIF found with MAC fa:16:3e:0d:80:ee, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:33:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received event network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:33:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] Acquiring lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:33:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:33:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:33:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] No waiting events found dispatching network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:33:55 user nova-compute[71507]: WARNING nova.compute.manager [req-10cd02f6-09bb-48ca-8630-818435aff703 req-f7fc645f-08e7-46d4-8263-3124c1ade256 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received unexpected event network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef for instance with vm_state building and task_state spawning.
Apr 13 15:33:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:33:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400037.736948, 362ab343-a3a0-46e0-a0a7-c25e60133227 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:33:57 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] VM Resumed (Lifecycle Event)
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:33:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Instance spawned successfully.
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:33:57 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400037.738198, 362ab343-a3a0-46e0-a0a7-c25e60133227 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:33:57 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] VM Started (Lifecycle Event)
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:33:57 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received event network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] Acquiring lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] No waiting events found dispatching network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:33:57 user nova-compute[71507]: WARNING nova.compute.manager [req-d18497a0-fec8-4daa-aa49-592a500b919e req-7e4e28ac-b2c2-4e4b-aa04-9e7883c08859 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received unexpected event network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef for instance with vm_state building and task_state spawning.
Apr 13 15:33:57 user nova-compute[71507]: INFO nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Took 4.94 seconds to spawn the instance on the hypervisor.
Apr 13 15:33:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:33:57 user nova-compute[71507]: INFO nova.compute.manager [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Took 10.09 seconds to build instance.
Apr 13 15:33:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ecac8108-71ea-45a0-8227-123e944a391d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.192s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:33:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:33:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:06 user nova-compute[71507]: INFO nova.compute.manager [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Terminating instance
Apr 13 15:34:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received event network-vif-unplugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] Acquiring lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] No waiting events found dispatching network-vif-unplugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-3f29e79c-dff6-4b34-a263-c9b461e0511b req-85d47b50-7f72-43a0-ae6b-dfe13566a0d5 service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received event network-vif-unplugged-51fbfc5f-6a68-41b6-9153-192b47c76902 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Instance destroyed successfully.
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.objects.instance [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lazy-loading 'resources' on Instance uuid 22bb22bd-efa8-4679-979a-dd0ce28a79e3 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2052126560',display_name='tempest-ServersNegativeTestJSON-server-2052126560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2052126560',id=30,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:25:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ac07b9454744832b26bf6bd126763ec',ramdisk_id='',reservation_id='r-7hzhimt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-187650290',owner_user_name='tempest-ServersNegativeTestJSON-187650290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:25:33Z,user_data=None,user_id='3a6955546e4f4292a25acad709d27953',uuid=22bb22bd-efa8-4679-979a-dd0ce28a79e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converting VIF {"id": "51fbfc5f-6a68-41b6-9153-192b47c76902", "address": "fa:16:3e:c6:4a:50", "network": {"id": "8c2be808-8e48-40ed-8182-2243a199bf06", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-148903662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ac07b9454744832b26bf6bd126763ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fbfc5f-6a", "ovs_interfaceid": "51fbfc5f-6a68-41b6-9153-192b47c76902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:4a:50,bridge_name='br-int',has_traffic_filtering=True,id=51fbfc5f-6a68-41b6-9153-192b47c76902,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fbfc5f-6a') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG os_vif [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:4a:50,bridge_name='br-int',has_traffic_filtering=True,id=51fbfc5f-6a68-41b6-9153-192b47c76902,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fbfc5f-6a') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51fbfc5f-6a, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:34:07 user nova-compute[71507]: INFO os_vif [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:4a:50,bridge_name='br-int',has_traffic_filtering=True,id=51fbfc5f-6a68-41b6-9153-192b47c76902,network=Network(8c2be808-8e48-40ed-8182-2243a199bf06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fbfc5f-6a')
Apr 13 15:34:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Deleting instance files /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3_del
Apr 13 15:34:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Deletion of /opt/stack/data/nova/instances/22bb22bd-efa8-4679-979a-dd0ce28a79e3_del complete
Apr 13 15:34:07 user nova-compute[71507]: INFO nova.compute.manager [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 15:34:07 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:34:07 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Took 0.54 seconds to deallocate network for instance.
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received event network-vif-deleted-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:07 user nova-compute[71507]: INFO nova.compute.manager [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Neutron deleted interface 51fbfc5f-6a68-41b6-9153-192b47c76902; detaching it from the instance and deleting it from the info cache
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.network.neutron [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-e6e5c56c-d357-4631-b1ec-8ed8247ce30a req-bb56e5e0-10cd-4cfb-bb9b-01a4d476b8df service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Detach interface failed, port_id=51fbfc5f-6a68-41b6-9153-192b47c76902, reason: Instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3 could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:08 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:34:08 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:34:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:08 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Deleted allocations for instance 22bb22bd-efa8-4679-979a-dd0ce28a79e3
Apr 13 15:34:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-458c9d3b-fd5f-45cf-917a-7779db603482 tempest-ServersNegativeTestJSON-187650290 tempest-ServersNegativeTestJSON-187650290-project-member] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received event network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Acquiring lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] No waiting events found dispatching network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:34:09 user nova-compute[71507]: WARNING nova.compute.manager [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received unexpected event network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 for instance with vm_state deleted and task_state None.
Apr 13 15:34:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received event network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Acquiring lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] Lock "22bb22bd-efa8-4679-979a-dd0ce28a79e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] No waiting events found dispatching network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:34:09 user nova-compute[71507]: WARNING nova.compute.manager [req-9856b982-3b49-4822-b084-ee09484e18e4 req-446f0827-2d9c-4790-b66a-b15a6bf0480e service nova] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Received unexpected event network-vif-plugged-51fbfc5f-6a68-41b6-9153-192b47c76902 for instance with vm_state deleted and task_state None.
Apr 13 15:34:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_power_states {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 58e8e652-d56c-45b6-92ff-a50406ea48e9 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 4211d816-b8aa-452e-9587-bf131e42d643 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 362ab343-a3a0-46e0-a0a7-c25e60133227 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "4211d816-b8aa-452e-9587-bf131e42d643" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "362ab343-a3a0-46e0-a0a7-c25e60133227" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "4211d816-b8aa-452e-9587-bf131e42d643" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:22 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400047.2748814, 22bb22bd-efa8-4679-979a-dd0ce28a79e3 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:34:22 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] VM Stopped (Lifecycle Event)
Apr 13 15:34:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-eaa8694c-375d-435b-8f30-1fe36902b5c3 None None] [instance: 22bb22bd-efa8-4679-979a-dd0ce28a79e3] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:34:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:28 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:34:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:32 user nova-compute[71507]: INFO nova.compute.manager [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Terminating instance
Apr 13 15:34:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-unplugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] No waiting events found dispatching network-vif-unplugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-5678719e-0613-4907-8239-3eee7490972c req-34793f1e-edb5-4d7a-8147-bee31a5790c8 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-unplugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Instance destroyed successfully.
Apr 13 15:34:33 user nova-compute[71507]: DEBUG nova.objects.instance [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'resources' on Instance uuid 4211d816-b8aa-452e-9587-bf131e42d643 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-243297081',display_name='tempest-ServerActionsTestJSON-server-243297081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-243297081',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:30:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-c36rb19c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=4211d816-b8aa-452e-9587-bf131e42d643,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "address": "fa:16:3e:9f:e0:7d", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape42a12d0-d0", "ovs_interfaceid": "e42a12d0-d042-4277-83a6-7141c1df1ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_vif [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape42a12d0-d0, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:34:33 user nova-compute[71507]: INFO os_vif [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e0:7d,bridge_name='br-int',has_traffic_filtering=True,id=e42a12d0-d042-4277-83a6-7141c1df1ea2,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape42a12d0-d0')
Apr 13 15:34:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRynUupX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:34:33 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33daf32-3ea1-4b73-ac4f-0fec33eb51de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:34:33 user nova-compute[71507]: No targets found.
Apr 13 15:34:33 user nova-compute[71507]: iSNS:
Apr 13 15:34:33 user nova-compute[71507]: No targets found.
Apr 13 15:34:33 user nova-compute[71507]: STATIC:
Apr 13 15:34:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002
Apr 13 15:34:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:34:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:34:33 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb
Apr 13 15:34:33 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:34:33 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:34:33 user nova-compute[71507]: FIRMWARE:
Apr 13 15:34:33 user nova-compute[71507]: No targets found.
Apr 13 15:34:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:34:33 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:34:33 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdbab89-7970-4f5b-bb13-5b1aa0099ef0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cbab92-c9fd-4167-aa8e-c6800680c5a5]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:34:33 user nova-compute[71507]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:34:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 (non-flash)
Apr 13 15:34:33 user nova-compute[71507]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:34:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab28957880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f611d568-07d9-4fb5-ab47-e52c90a6a367]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed9a543-a4a2-4330-9c34-600dc40d4e90]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ff5d74-7f09-498c-b15c-12d2fd637ab3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cbfcb7-dcd9-4ab8-ac33-b379d293dcf7]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[73333f75-12b4-43df-a81d-1ab559659047]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afaedec-7c50-431d-97eb-db22fcecb2fc]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260]
Apr 13 15:34:33 user nova-compute[71507]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002, portal: 172.16.0.220,3260] successful.
Apr 13 15:34:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec0bd78-5754-47ac-8a42-bbdd51d2d002 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5228e4-7c45-416b-b69f-a9a852411b7f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] <== disconnect_volume: return (301ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:34:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Deleting instance files /opt/stack/data/nova/instances/4211d816-b8aa-452e-9587-bf131e42d643_del
Apr 13 15:34:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Deletion of /opt/stack/data/nova/instances/4211d816-b8aa-452e-9587-bf131e42d643_del complete
Apr 13 15:34:33 user nova-compute[71507]: INFO nova.compute.manager [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 13 15:34:33 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:34:33 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:34:34 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:34:34 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Took 0.65 seconds to deallocate network for instance.
Apr 13 15:34:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-deleted-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:34 user nova-compute[71507]: INFO nova.compute.manager [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Neutron deleted interface e42a12d0-d042-4277-83a6-7141c1df1ea2; detaching it from the instance and deleting it from the info cache
Apr 13 15:34:34 user nova-compute[71507]: DEBUG nova.network.neutron [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:34:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-58d0e896-2819-4e84-b61a-25aa0af76c4f req-1d652cad-37b0-4eea-974e-e0797532f1b3 service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Detach interface failed, port_id=e42a12d0-d042-4277-83a6-7141c1df1ea2, reason: Instance 4211d816-b8aa-452e-9587-bf131e42d643 could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:34:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] Acquiring lock "4211d816-b8aa-452e-9587-bf131e42d643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] Lock "4211d816-b8aa-452e-9587-bf131e42d643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:34 user nova-compute[71507]: DEBUG nova.compute.manager [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] No waiting events found dispatching network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:34:34 user nova-compute[71507]: WARNING nova.compute.manager [req-bf52eab8-d036-45c9-beea-3de4c062ea20 req-dd919d84-615c-43ce-8b5b-1936e9bcb54f service nova] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Received unexpected event network-vif-plugged-e42a12d0-d042-4277-83a6-7141c1df1ea2 for instance with vm_state active and task_state deleting.
Apr 13 15:34:35 user nova-compute[71507]: INFO nova.compute.manager [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Took 0.76 seconds to detach 1 volumes for instance.
Apr 13 15:34:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Deleting volume: 3ec0bd78-5754-47ac-8a42-bbdd51d2d002 {{(pid=71507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 15:34:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:35 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:34:35 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:34:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:35 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Deleted allocations for instance 4211d816-b8aa-452e-9587-bf131e42d643
Apr 13 15:34:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-ddedb06d-1a08-481d-849c-72e74e87eade tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "4211d816-b8aa-452e-9587-bf131e42d643" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.946s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:38 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:34:38 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:34:38 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8449MB free_disk=26.130699157714844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 58e8e652-d56c-45b6-92ff-a50406ea48e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 9761101e-4bce-4e7b-8137-569bf8d27f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:34:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:41 user nova-compute[71507]: INFO nova.compute.manager [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Terminating instance
Apr 13 15:34:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-unplugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] No waiting events found dispatching network-vif-unplugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-884ae4af-eb49-460d-90d4-03ae8ad3bb0f req-4755d4b9-fe9d-4342-8c50-ac1b24f9060e service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-unplugged-e2eabaa4-a35d-433f-850e-949af795e7ed for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:34:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:42 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Instance destroyed successfully.
Apr 13 15:34:42 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'resources' on Instance uuid 9761101e-4bce-4e7b-8137-569bf8d27f87 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-685773624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-685773624',id=37,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwAMm4sU/Gj3Vzrh3VZEg6lMGBJZ4u46yLNWpEl8KgjKMuyhNTe4lr+wZMx5cIPjHcyJlvVwL2g6JxTANaHJ7wVMvtjiUslCjAeTc41ba0ytt3OvquWPsvKDw4riIwsTg==',key_name='tempest-keypair-1306550106',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-v5c2531s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:32:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=9761101e-4bce-4e7b-8137-569bf8d27f87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "e2eabaa4-a35d-433f-850e-949af795e7ed", "address": "fa:16:3e:bd:e2:6c", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2eabaa4-a3", "ovs_interfaceid": "e2eabaa4-a35d-433f-850e-949af795e7ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG os_vif [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2eabaa4-a3, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:34:42 user nova-compute[71507]: INFO os_vif [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2eabaa4-a35d-433f-850e-949af795e7ed,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2eabaa4-a3')
Apr 13 15:34:42 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Deleting instance files /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87_del
Apr 13 15:34:42 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Deletion of /opt/stack/data/nova/instances/9761101e-4bce-4e7b-8137-569bf8d27f87_del complete
Apr 13 15:34:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:34:42 user nova-compute[71507]: INFO nova.compute.manager [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 13 15:34:42 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:34:42 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:34:43 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Took 1.04 seconds to deallocate network for instance.
Apr 13 15:34:43 user nova-compute[71507]: DEBUG nova.compute.manager [req-f75bd36b-8dfa-40c1-8087-2242be0d0d07 req-6d2f56fa-fba6-4de6-baac-74e5a99bb2e3 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-deleted-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:43 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Deleted allocations for instance 9761101e-4bce-4e7b-8137-569bf8d27f87
Apr 13 15:34:43 user nova-compute[71507]: DEBUG nova.compute.manager [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] Acquiring lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:43 user nova-compute[71507]: DEBUG nova.compute.manager [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] No waiting events found dispatching network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:34:43 user nova-compute[71507]: WARNING nova.compute.manager [req-fedfa2f4-75b2-40d9-ad27-6b1292bec5d3 req-fe95db45-44da-4aa6-8347-cd19715e24b2 service nova] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Received unexpected event network-vif-plugged-e2eabaa4-a35d-433f-850e-949af795e7ed for instance with vm_state deleted and task_state None.
Apr 13 15:34:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d4a4670b-a012-4b5d-86d6-39e7b6d9225e tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "9761101e-4bce-4e7b-8137-569bf8d27f87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.333s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:34:46 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:48 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400073.214277, 4211d816-b8aa-452e-9587-bf131e42d643 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:34:48 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] VM Stopped (Lifecycle Event)
Apr 13 15:34:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-2ca4b5af-88ff-4469-a3d6-f52e5f1243bf None None] [instance: 4211d816-b8aa-452e-9587-bf131e42d643] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:34:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:50 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:34:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:34:57 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400082.3633254, 9761101e-4bce-4e7b-8137-569bf8d27f87 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:34:57 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] VM Stopped (Lifecycle Event)
Apr 13 15:34:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-fbd7d7aa-9bbb-4997-aa64-6ae2ae970ee6 None None] [instance: 9761101e-4bce-4e7b-8137-569bf8d27f87] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:34:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:34:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:35:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:35:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:35:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:35:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:35:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:23 user nova-compute[71507]: INFO nova.compute.manager [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Terminating instance
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-unplugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] No waiting events found dispatching network-vif-unplugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.compute.manager [req-6f004e5a-9478-45f3-a541-ce978cbbdcfd req-c2008046-1385-41e1-8b3b-a9d639100adf service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-unplugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Instance destroyed successfully.
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.objects.instance [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lazy-loading 'resources' on Instance uuid 58e8e652-d56c-45b6-92ff-a50406ea48e9 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-635850251',display_name='tempest-ServerActionsTestJSON-server-635850251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-635850251',id=31,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJU3T46itI9hc6jDtYrI62NhrhqhRI2Ck5Q0zlVubpwNjm8vKzn3tP7Mw0z6Sx+yOo6Z3wY4i4hPyC376CTfYL9NYhqgz1m6qyt4gwyg4AcL2Rw27s75Cq7iAczdisRRA==',key_name='tempest-keypair-164816521',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:26:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9154e4239a1a42a3820c27563ba0513f',ramdisk_id='',reservation_id='r-lgh5ks3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-423674903',owner_user_name='tempest-ServerActionsTestJSON-423674903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:26:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c12c62d4137473596571e523163e718',uuid=58e8e652-d56c-45b6-92ff-a50406ea48e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converting VIF {"id": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "address": "fa:16:3e:9b:31:ea", "network": {"id": "4ed78a75-b065-400b-8eb2-71085d406a1e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-768069470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9154e4239a1a42a3820c27563ba0513f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018bebd6-43", "ovs_interfaceid": "018bebd6-4323-4f9d-8c6d-6da9a7934a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:31:ea,bridge_name='br-int',has_traffic_filtering=True,id=018bebd6-4323-4f9d-8c6d-6da9a7934a97,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018bebd6-43') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG os_vif [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:31:ea,bridge_name='br-int',has_traffic_filtering=True,id=018bebd6-4323-4f9d-8c6d-6da9a7934a97,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018bebd6-43') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap018bebd6-43, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:35:23 user nova-compute[71507]: INFO os_vif [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:31:ea,bridge_name='br-int',has_traffic_filtering=True,id=018bebd6-4323-4f9d-8c6d-6da9a7934a97,network=Network(4ed78a75-b065-400b-8eb2-71085d406a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018bebd6-43')
Apr 13 15:35:23 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Deleting instance files /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9_del
Apr 13 15:35:23 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Deletion of /opt/stack/data/nova/instances/58e8e652-d56c-45b6-92ff-a50406ea48e9_del complete
Apr 13 15:35:23 user nova-compute[71507]: INFO nova.compute.manager [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 13 15:35:23 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:35:23 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:35:24 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Took 0.82 seconds to deallocate network for instance.
Apr 13 15:35:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-2753de40-5313-4a56-b1a6-3aaa49e0fdb0 req-8e006b07-952e-4d18-81e4-744d34acefa7 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-deleted-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:35:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:24 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Deleted allocations for instance 58e8e652-d56c-45b6-92ff-a50406ea48e9
Apr 13 15:35:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-678c24d6-f33a-4e65-b7b7-6b037785f975 tempest-ServerActionsTestJSON-423674903 tempest-ServerActionsTestJSON-423674903-project-member] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] No waiting events found dispatching network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:25 user nova-compute[71507]: WARNING nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received unexpected event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance with vm_state deleted and task_state None.
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] No waiting events found dispatching network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:25 user nova-compute[71507]: WARNING nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received unexpected event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance with vm_state deleted and task_state None.
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] No waiting events found dispatching network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:25 user nova-compute[71507]: WARNING nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received unexpected event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance with vm_state deleted and task_state None.
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-unplugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] No waiting events found dispatching network-vif-unplugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:25 user nova-compute[71507]: WARNING nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received unexpected event network-vif-unplugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance with vm_state deleted and task_state None.
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Acquiring lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] Lock "58e8e652-d56c-45b6-92ff-a50406ea48e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] No waiting events found dispatching network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:25 user nova-compute[71507]: WARNING nova.compute.manager [req-84fd2c13-08d2-450b-8493-48678bb93aa6 req-89a1dbea-d3a2-43a1-99a7-485e4c54b463 service nova] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Received unexpected event network-vif-plugged-018bebd6-4323-4f9d-8c6d-6da9a7934a97 for instance with vm_state deleted and task_state None.
Apr 13 15:35:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:30 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:35:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:35:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:35:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:35:30 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:35:30 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid 362ab343-a3a0-46e0-a0a7-c25e60133227 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:35:31 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Updating instance_info_cache with network_info: [{"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:35:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:35:31 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:35:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:35:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:35:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:35:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:35:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:35:35 user nova-compute[71507]: INFO nova.compute.claims [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Claim successful on node user
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:35:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.policy [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0bc1b61d8dc44aa8460fe2cd510c0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51df4613a6664a0fab857a9a83b6df62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:35:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Creating image(s)
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk 1073741824" returned: 0 in 0.058s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.148s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Cannot resize image /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'migration_context' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Ensure instance console log exists: /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Successfully created port: 1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Successfully updated port: 1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquired lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-changed-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.compute.manager [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Refreshing instance network info cache due to event network-changed-1cb2ae52-e4fa-4627-b3f3-301af5732358. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] Acquiring lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Releasing lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance network_info: |[{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] Acquired lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.network.neutron [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Refreshing network info cache for port 1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Start _get_guest_xml network_info=[{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:35:37 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:35:37 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1461623425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1461623425',id=40,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnB1XKsk+V/s+8svM9sTYLSdCjPIha2/SxAlkQCj7RRjLtDmMIHKWKDxVW7nV/0+Ei3Tt4l3pDA6FtDGaEcY6JOCIXBZUCsdZhUWv5y0PmkdIGRBBVocQPBaKYwc7DDpg==',key_name='tempest-keypair-249143367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-iqgyjdxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=32b179d3-712f-47bc-94ad-387c8ca77380,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.objects.instance [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'pci_devices' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:35:37 user nova-compute[71507]:   <uuid>32b179d3-712f-47bc-94ad-387c8ca77380</uuid>
Apr 13 15:35:37 user nova-compute[71507]:   <name>instance-00000028</name>
Apr 13 15:35:37 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:35:37 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:35:37 user nova-compute[71507]:   <metadata>
Apr 13 15:35:37 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:35:37 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:35:37 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1461623425</nova:name>
Apr 13 15:35:37 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:35:37</nova:creationTime>
Apr 13 15:35:37 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:35:37 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:35:37 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:35:37 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:35:37 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:35:37 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:35:37 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:35:37 user nova-compute[71507]:       <nova:owner>
Apr 13 15:35:37 user nova-compute[71507]:         <nova:user uuid="a0bc1b61d8dc44aa8460fe2cd510c0a4">tempest-AttachVolumeShelveTestJSON-1608248430-project-member</nova:user>
Apr 13 15:35:37 user nova-compute[71507]:         <nova:project uuid="51df4613a6664a0fab857a9a83b6df62">tempest-AttachVolumeShelveTestJSON-1608248430</nova:project>
Apr 13 15:35:37 user nova-compute[71507]:       </nova:owner>
Apr 13 15:35:37 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:35:37 user nova-compute[71507]:       <nova:ports>
Apr 13 15:35:37 user nova-compute[71507]:         <nova:port uuid="1cb2ae52-e4fa-4627-b3f3-301af5732358">
Apr 13 15:35:37 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 15:35:37 user nova-compute[71507]:         </nova:port>
Apr 13 15:35:37 user nova-compute[71507]:       </nova:ports>
Apr 13 15:35:37 user nova-compute[71507]:     </nova:instance>
Apr 13 15:35:37 user nova-compute[71507]:   </metadata>
Apr 13 15:35:37 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:35:37 user nova-compute[71507]:     <system>
Apr 13 15:35:37 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:35:37 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:35:37 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:35:37 user nova-compute[71507]:       <entry name="serial">32b179d3-712f-47bc-94ad-387c8ca77380</entry>
Apr 13 15:35:37 user nova-compute[71507]:       <entry name="uuid">32b179d3-712f-47bc-94ad-387c8ca77380</entry>
Apr 13 15:35:37 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:35:37 user nova-compute[71507]:     </system>
Apr 13 15:35:37 user nova-compute[71507]:   </sysinfo>
Apr 13 15:35:37 user nova-compute[71507]:   <os>
Apr 13 15:35:37 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:35:37 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:35:37 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:35:37 user nova-compute[71507]:   </os>
Apr 13 15:35:37 user nova-compute[71507]:   <features>
Apr 13 15:35:37 user nova-compute[71507]:     <acpi/>
Apr 13 15:35:37 user nova-compute[71507]:     <apic/>
Apr 13 15:35:37 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:35:37 user nova-compute[71507]:   </features>
Apr 13 15:35:37 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:35:37 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:35:37 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:35:37 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:35:37 user nova-compute[71507]:   </clock>
Apr 13 15:35:37 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:35:37 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:35:37 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:35:37 user nova-compute[71507]:   </cpu>
Apr 13 15:35:37 user nova-compute[71507]:   <devices>
Apr 13 15:35:37 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:35:37 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:35:37 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk"/>
Apr 13 15:35:37 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:35:37 user nova-compute[71507]:     </disk>
Apr 13 15:35:37 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:35:37 user nova-compute[71507]:       <mac address="fa:16:3e:f5:18:a8"/>
Apr 13 15:35:37 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:35:37 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:35:37 user nova-compute[71507]:       <target dev="tap1cb2ae52-e4"/>
Apr 13 15:35:37 user nova-compute[71507]:     </interface>
Apr 13 15:35:37 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:35:37 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/console.log" append="off"/>
Apr 13 15:35:37 user nova-compute[71507]:     </serial>
Apr 13 15:35:37 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:35:37 user nova-compute[71507]:     <video>
Apr 13 15:35:37 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:35:37 user nova-compute[71507]:     </video>
Apr 13 15:35:37 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:35:37 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:35:37 user nova-compute[71507]:     </rng>
Apr 13 15:35:37 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:35:37 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:35:37 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:35:37 user nova-compute[71507]:     </memballoon>
Apr 13 15:35:37 user nova-compute[71507]:   </devices>
Apr 13 15:35:37 user nova-compute[71507]: </domain>
Apr 13 15:35:37 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1461623425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1461623425',id=40,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnB1XKsk+V/s+8svM9sTYLSdCjPIha2/SxAlkQCj7RRjLtDmMIHKWKDxVW7nV/0+Ei3Tt4l3pDA6FtDGaEcY6JOCIXBZUCsdZhUWv5y0PmkdIGRBBVocQPBaKYwc7DDpg==',key_name='tempest-keypair-249143367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-iqgyjdxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=32b179d3-712f-47bc-94ad-387c8ca77380,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG os_vif [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cb2ae52-e4, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1cb2ae52-e4, col_values=(('external_ids', {'iface-id': '1cb2ae52-e4fa-4627-b3f3-301af5732358', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:18:a8', 'vm-uuid': '32b179d3-712f-47bc-94ad-387c8ca77380'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:37 user nova-compute[71507]: INFO os_vif [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4')
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:35:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] No VIF found with MAC fa:16:3e:f5:18:a8, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:35:38 user nova-compute[71507]: DEBUG nova.network.neutron [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updated VIF entry in instance network info cache for port 1cb2ae52-e4fa-4627-b3f3-301af5732358. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:35:38 user nova-compute[71507]: DEBUG nova.network.neutron [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:35:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5475a116-a23d-4f3c-8f37-e9fec4c1093e req-ab7a3f65-14a6-4901-bbff-2ad6a933f72d service nova] Releasing lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:35:38 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400123.6232386, 58e8e652-d56c-45b6-92ff-a50406ea48e9 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:35:38 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] VM Stopped (Lifecycle Event)
Apr 13 15:35:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d2ca9488-59e4-40d0-a8ee-a9024ad4aabe None None] [instance: 58e8e652-d56c-45b6-92ff-a50406ea48e9] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG nova.compute.manager [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:39 user nova-compute[71507]: DEBUG nova.compute.manager [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] No waiting events found dispatching network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:39 user nova-compute[71507]: WARNING nova.compute.manager [req-10d39988-1791-4dcc-9a32-62d027e6a05f req-d1450281-1a5a-4075-a718-af28c1834b9e service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received unexpected event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance with vm_state building and task_state spawning.
Apr 13 15:35:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:35:40 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:35:40 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:35:40 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=26.158416748046875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 32b179d3-712f-47bc-94ad-387c8ca77380 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:35:40 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400141.683608, 32b179d3-712f-47bc-94ad-387c8ca77380 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:35:41 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] VM Resumed (Lifecycle Event)
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:35:41 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance spawned successfully.
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.manager [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] No waiting events found dispatching network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:41 user nova-compute[71507]: WARNING nova.compute.manager [req-809af43d-bdf7-4133-8795-01bbab3156f1 req-1c495b62-55c8-4e62-b66a-a936aa2bcab3 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received unexpected event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance with vm_state building and task_state spawning.
Apr 13 15:35:41 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400141.6875827, 32b179d3-712f-47bc-94ad-387c8ca77380 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:35:41 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] VM Started (Lifecycle Event)
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:35:41 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:35:41 user nova-compute[71507]: INFO nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Took 6.07 seconds to spawn the instance on the hypervisor.
Apr 13 15:35:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:41 user nova-compute[71507]: INFO nova.compute.manager [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Took 6.64 seconds to build instance.
Apr 13 15:35:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-917212cf-87eb-42cb-804f-5277fc0ab549 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.740s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "a8e5dbae-1051-494e-9383-8d334bcd9f97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:35:42 user nova-compute[71507]: INFO nova.compute.claims [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Claim successful on node user
Apr 13 15:35:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:35:42 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:35:42 user nova-compute[71507]: INFO nova.virt.block_device [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Booting with volume snapshot f6d86cc4-e799-4a3d-abb3-e25adf5371bb at /dev/vda
Apr 13 15:35:42 user nova-compute[71507]: DEBUG nova.policy [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:35:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:43 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Successfully created port: 68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:35:44 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Successfully updated port: 68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:35:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "refresh_cache-a8e5dbae-1051-494e-9383-8d334bcd9f97" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:35:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquired lock "refresh_cache-a8e5dbae-1051-494e-9383-8d334bcd9f97" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:35:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:35:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received event network-changed-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:44 user nova-compute[71507]: DEBUG nova.compute.manager [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Refreshing instance network info cache due to event network-changed-68238072-7820-4474-a63e-b28f6e9e9d86. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:35:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] Acquiring lock "refresh_cache-a8e5dbae-1051-494e-9383-8d334bcd9f97" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:35:44 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:35:45 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:45 user nova-compute[71507]: DEBUG nova.network.neutron [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Updating instance_info_cache with network_info: [{"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:35:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Releasing lock "refresh_cache-a8e5dbae-1051-494e-9383-8d334bcd9f97" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:35:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Instance network_info: |[{"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:35:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] Acquired lock "refresh_cache-a8e5dbae-1051-494e-9383-8d334bcd9f97" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:35:45 user nova-compute[71507]: DEBUG nova.network.neutron [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Refreshing network info cache for port 68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:35:46 user nova-compute[71507]: DEBUG nova.network.neutron [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Updated VIF entry in instance network info cache for port 68238072-7820-4474-a63e-b28f6e9e9d86. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:35:46 user nova-compute[71507]: DEBUG nova.network.neutron [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Updating instance_info_cache with network_info: [{"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:35:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3a0fb8bf-815d-4f40-9133-5fb96f22b309 req-b0ea9efb-7200-4311-9c97-4a31d8e9ce20 service nova] Releasing lock "refresh_cache-a8e5dbae-1051-494e-9383-8d334bcd9f97" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:35:47 user nova-compute[71507]: INFO nova.compute.claims [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Claim successful on node user
Apr 13 15:35:47 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:35:47 user nova-compute[71507]: DEBUG nova.network.neutron [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:35:47 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:35:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.policy [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '300cbdea17c74a418f50e2d581691ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a40f5a9b5e4f3fb8467b6ea304bbe5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:35:48 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Creating image(s)
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "/opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "/opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.145s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk 1073741824" returned: 0 in 0.056s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG os_brick.utils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Cannot resize image /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.objects.instance [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'migration_context' on Instance uuid b2ed660b-7c9a-4a67-a48c-9bbbacc046bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b118c29-b15e-4d23-9203-d2dead77f8a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.network.neutron [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Successfully created port: d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Ensure instance console log exists: /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beda376-964d-4518-bd1a-f32490b53828]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eefcdfc-1ffa-4d7d-9bfe-cee14c26500a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebdbf46-1f5f-410c-9102-bac7140ddd2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:35:48 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:35:48 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca2009-cc26-4f50-9017-ffd1b9311981]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG os_brick.utils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:35:48 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Updating existing volume attachment record: a78cea94-d054-4e82-9c72-a2464d90f2cc {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Successfully updated port: d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "refresh_cache-b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquired lock "refresh_cache-b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received event network-changed-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.compute.manager [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Refreshing instance network info cache due to event network-changed-d9dc5c9c-85d3-406a-be61-8f3cc9354712. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] Acquiring lock "refresh_cache-b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.network.neutron [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Updating instance_info_cache with network_info: [{"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Releasing lock "refresh_cache-b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Instance network_info: |[{"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] Acquired lock "refresh_cache-b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.network.neutron [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Refreshing network info cache for port d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Start _get_guest_xml network_info=[{"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:35:49 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:35:49 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-269338813',display_name='tempest-VolumesSnapshotTestJSON-instance-269338813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-269338813',id=42,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0a40f5a9b5e4f3fb8467b6ea304bbe5',ramdisk_id='',reservation_id='r-ct1123ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-392588653',owner_user_name='tempest-VolumesSnapshotTestJSON-392588653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:35:48Z,user_data=None,user_id='300cbdea17c74a418f50e2d581691ad3',uuid=b2ed660b-7c9a-4a67-a48c-9bbbacc046bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converting VIF {"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:f1,bridge_name='br-int',has_traffic_filtering=True,id=d9dc5c9c-85d3-406a-be61-8f3cc9354712,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc5c9c-85') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.objects.instance [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'pci_devices' on Instance uuid b2ed660b-7c9a-4a67-a48c-9bbbacc046bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:35:49 user nova-compute[71507]:   <uuid>b2ed660b-7c9a-4a67-a48c-9bbbacc046bd</uuid>
Apr 13 15:35:49 user nova-compute[71507]:   <name>instance-0000002a</name>
Apr 13 15:35:49 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:35:49 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:35:49 user nova-compute[71507]:   <metadata>
Apr 13 15:35:49 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:35:49 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:35:49 user nova-compute[71507]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-269338813</nova:name>
Apr 13 15:35:49 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:35:49</nova:creationTime>
Apr 13 15:35:49 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:35:49 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:35:49 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:35:49 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:35:49 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:35:49 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:35:49 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:35:49 user nova-compute[71507]:       <nova:owner>
Apr 13 15:35:49 user nova-compute[71507]:         <nova:user uuid="300cbdea17c74a418f50e2d581691ad3">tempest-VolumesSnapshotTestJSON-392588653-project-member</nova:user>
Apr 13 15:35:49 user nova-compute[71507]:         <nova:project uuid="a0a40f5a9b5e4f3fb8467b6ea304bbe5">tempest-VolumesSnapshotTestJSON-392588653</nova:project>
Apr 13 15:35:49 user nova-compute[71507]:       </nova:owner>
Apr 13 15:35:49 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:35:49 user nova-compute[71507]:       <nova:ports>
Apr 13 15:35:49 user nova-compute[71507]:         <nova:port uuid="d9dc5c9c-85d3-406a-be61-8f3cc9354712">
Apr 13 15:35:49 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 15:35:49 user nova-compute[71507]:         </nova:port>
Apr 13 15:35:49 user nova-compute[71507]:       </nova:ports>
Apr 13 15:35:49 user nova-compute[71507]:     </nova:instance>
Apr 13 15:35:49 user nova-compute[71507]:   </metadata>
Apr 13 15:35:49 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:35:49 user nova-compute[71507]:     <system>
Apr 13 15:35:49 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:35:49 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:35:49 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:35:49 user nova-compute[71507]:       <entry name="serial">b2ed660b-7c9a-4a67-a48c-9bbbacc046bd</entry>
Apr 13 15:35:49 user nova-compute[71507]:       <entry name="uuid">b2ed660b-7c9a-4a67-a48c-9bbbacc046bd</entry>
Apr 13 15:35:49 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:35:49 user nova-compute[71507]:     </system>
Apr 13 15:35:49 user nova-compute[71507]:   </sysinfo>
Apr 13 15:35:49 user nova-compute[71507]:   <os>
Apr 13 15:35:49 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:35:49 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:35:49 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:35:49 user nova-compute[71507]:   </os>
Apr 13 15:35:49 user nova-compute[71507]:   <features>
Apr 13 15:35:49 user nova-compute[71507]:     <acpi/>
Apr 13 15:35:49 user nova-compute[71507]:     <apic/>
Apr 13 15:35:49 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:35:49 user nova-compute[71507]:   </features>
Apr 13 15:35:49 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:35:49 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:35:49 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:35:49 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:35:49 user nova-compute[71507]:   </clock>
Apr 13 15:35:49 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:35:49 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:35:49 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:35:49 user nova-compute[71507]:   </cpu>
Apr 13 15:35:49 user nova-compute[71507]:   <devices>
Apr 13 15:35:49 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:35:49 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:35:49 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk"/>
Apr 13 15:35:49 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:35:49 user nova-compute[71507]:     </disk>
Apr 13 15:35:49 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:35:49 user nova-compute[71507]:       <mac address="fa:16:3e:35:54:f1"/>
Apr 13 15:35:49 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:35:49 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:35:49 user nova-compute[71507]:       <target dev="tapd9dc5c9c-85"/>
Apr 13 15:35:49 user nova-compute[71507]:     </interface>
Apr 13 15:35:49 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:35:49 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/console.log" append="off"/>
Apr 13 15:35:49 user nova-compute[71507]:     </serial>
Apr 13 15:35:49 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:35:49 user nova-compute[71507]:     <video>
Apr 13 15:35:49 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:35:49 user nova-compute[71507]:     </video>
Apr 13 15:35:49 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:35:49 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:35:49 user nova-compute[71507]:     </rng>
Apr 13 15:35:49 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:35:49 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:35:49 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:35:49 user nova-compute[71507]:     </memballoon>
Apr 13 15:35:49 user nova-compute[71507]:   </devices>
Apr 13 15:35:49 user nova-compute[71507]: </domain>
Apr 13 15:35:49 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-269338813',display_name='tempest-VolumesSnapshotTestJSON-instance-269338813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-269338813',id=42,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0a40f5a9b5e4f3fb8467b6ea304bbe5',ramdisk_id='',reservation_id='r-ct1123ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-392588653',owner_user_name='tempest-VolumesSnapshotTestJSON-392588653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:35:48Z,user_data=None,user_id='300cbdea17c74a418f50e2d581691ad3',uuid=b2ed660b-7c9a-4a67-a48c-9bbbacc046bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converting VIF {"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:f1,bridge_name='br-int',has_traffic_filtering=True,id=d9dc5c9c-85d3-406a-be61-8f3cc9354712,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc5c9c-85') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG os_vif [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:f1,bridge_name='br-int',has_traffic_filtering=True,id=d9dc5c9c-85d3-406a-be61-8f3cc9354712,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc5c9c-85') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9dc5c9c-85, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9dc5c9c-85, col_values=(('external_ids', {'iface-id': 'd9dc5c9c-85d3-406a-be61-8f3cc9354712', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:54:f1', 'vm-uuid': 'b2ed660b-7c9a-4a67-a48c-9bbbacc046bd'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:35:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:50 user nova-compute[71507]: INFO os_vif [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:f1,bridge_name='br-int',has_traffic_filtering=True,id=d9dc5c9c-85d3-406a-be61-8f3cc9354712,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc5c9c-85')
Apr 13 15:35:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:35:50 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No VIF found with MAC fa:16:3e:35:54:f1, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:35:50 user nova-compute[71507]: DEBUG nova.network.neutron [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Updated VIF entry in instance network info cache for port d9dc5c9c-85d3-406a-be61-8f3cc9354712. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:35:50 user nova-compute[71507]: DEBUG nova.network.neutron [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Updating instance_info_cache with network_info: [{"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:35:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-02dd2d5f-2692-4ada-92f6-3361dc9f1910 req-6d0c20bf-7aef-4998-9089-fcc8e329629c service nova] Releasing lock "refresh_cache-b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:35:50 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received event network-vif-plugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:51 user nova-compute[71507]: DEBUG nova.compute.manager [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] No waiting events found dispatching network-vif-plugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:51 user nova-compute[71507]: WARNING nova.compute.manager [req-61d6595b-caa1-4d0f-84a3-656d6f366618 req-140ac837-69cf-4931-a06e-586ab684779a service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received unexpected event network-vif-plugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance with vm_state building and task_state spawning.
Apr 13 15:35:52 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:35:53 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Creating image(s)
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Ensure instance console log exists: /opt/stack/data/nova/instances/a8e5dbae-1051-494e-9383-8d334bcd9f97/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Start _get_guest_xml network_info=[{"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T15:35:39Z,direct_url=<?>,disk_format='qcow2',id=a8b51e62-45b1-4f4a-b622-38c5e601bfd8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1792062222',owner='d5d7f771264c4cd2bc595a2c525082d0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T15:35:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SgHNGdue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a8e5dbae-1051-494e-9383-8d334bcd9f97', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2fd9484-a7d6-4cb0-a5bb-01ef47449211', 'serial': 'b2fd9484-a7d6-4cb0-a5bb-01ef47449211'}, 'attachment_id': 'a78cea94-d054-4e82-9c72-a2464d90f2cc', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:35:53 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:35:53 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T15:35:39Z,direct_url=<?>,disk_format='qcow2',id=a8b51e62-45b1-4f4a-b622-38c5e601bfd8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1792062222',owner='d5d7f771264c4cd2bc595a2c525082d0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T15:35:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SgHNGdue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:35:53 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:35:53 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:35:53 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400153.5613725, b2ed660b-7c9a-4a67-a48c-9bbbacc046bd => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:35:53 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] VM Resumed (Lifecycle Event)
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[02355b79-8862-43c5-ae19-ede2ae2e8b69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:35:53 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Instance spawned successfully.
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e53fe49-9c71-4670-9f1c-683e8071b6d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211] added
Apr 13 15:35:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8286cb-0c83-447f-8d72-ab02919930cd]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:35:53 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400153.5624802, b2ed660b-7c9a-4a67-a48c-9bbbacc046bd => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:35:53 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] VM Started (Lifecycle Event)
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1b8bc4-2fd1-4746-8be6-a588d1b17d77]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SgHNGdue {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SgHNGdue" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[51039168-7883-4b1e-a5bb-10291b894b74]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SgHNGdue'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: INFO nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5dd190-80a4-4462-8883-a39dd4b86c78]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bd1d68-825f-433f-8b89-e5c6f8f90022]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:35:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:35:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received event network-vif-plugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] No waiting events found dispatching network-vif-plugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:53 user nova-compute[71507]: WARNING nova.compute.manager [req-5b9953a8-214a-4cce-9c03-0a264449ee44 req-ae71faeb-5205-4569-8b4c-66c7f5ec210f service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received unexpected event network-vif-plugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance with vm_state building and task_state spawning.
Apr 13 15:35:53 user nova-compute[71507]: INFO nova.compute.manager [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Took 6.14 seconds to build instance.
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d344e1d-9990-4dab-9b5b-ecb251525591]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211, portal: 172.16.0.220,3260]
Apr 13 15:35:53 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211, portal: 172.16.0.220,3260] successful.
Apr 13 15:35:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-626b03c0-a3cb-43df-a0bc-deae47b95678 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.252s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a907f1c-3881-4ec6-bb14-27f2f378331e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d44900-a183-478b-b71c-5d04905114fa]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:35:53 user nova-compute[71507]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 (non-flash)
Apr 13 15:35:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:35:53 user nova-compute[71507]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 (non-flash)
Apr 13 15:35:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5145514-f4c4-450e-95e2-21bb0e6d5af4]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:35:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SgHNGdue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23037303832323937', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037303832323937', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1243895427',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1243895427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1243895427',id=41,image_ref='a8b51e62-45b1-4f4a-b622-38c5e601bfd8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-9uw386vg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-374778702',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:35:43Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=a8e5dbae-1051-494e-9383-8d334bcd9f97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b5:b2,bridge_name='br-int',has_traffic_filtering=True,id=68238072-7820-4474-a63e-b28f6e9e9d86,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68238072-78') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG nova.objects.instance [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'pci_devices' on Instance uuid a8e5dbae-1051-494e-9383-8d334bcd9f97 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:35:54 user nova-compute[71507]:   <uuid>a8e5dbae-1051-494e-9383-8d334bcd9f97</uuid>
Apr 13 15:35:54 user nova-compute[71507]:   <name>instance-00000029</name>
Apr 13 15:35:54 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:35:54 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:35:54 user nova-compute[71507]:   <metadata>
Apr 13 15:35:54 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:35:54 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:35:54 user nova-compute[71507]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1243895427</nova:name>
Apr 13 15:35:54 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:35:53</nova:creationTime>
Apr 13 15:35:54 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:35:54 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:35:54 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:35:54 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:35:54 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:35:54 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:35:54 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:35:54 user nova-compute[71507]:       <nova:owner>
Apr 13 15:35:54 user nova-compute[71507]:         <nova:user uuid="0307fb8d127a41079e34355904352231">tempest-TestVolumeBootPattern-374778702-project-member</nova:user>
Apr 13 15:35:54 user nova-compute[71507]:         <nova:project uuid="d5d7f771264c4cd2bc595a2c525082d0">tempest-TestVolumeBootPattern-374778702</nova:project>
Apr 13 15:35:54 user nova-compute[71507]:       </nova:owner>
Apr 13 15:35:54 user nova-compute[71507]:       <nova:root type="image" uuid="a8b51e62-45b1-4f4a-b622-38c5e601bfd8"/>
Apr 13 15:35:54 user nova-compute[71507]:       <nova:ports>
Apr 13 15:35:54 user nova-compute[71507]:         <nova:port uuid="68238072-7820-4474-a63e-b28f6e9e9d86">
Apr 13 15:35:54 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 15:35:54 user nova-compute[71507]:         </nova:port>
Apr 13 15:35:54 user nova-compute[71507]:       </nova:ports>
Apr 13 15:35:54 user nova-compute[71507]:     </nova:instance>
Apr 13 15:35:54 user nova-compute[71507]:   </metadata>
Apr 13 15:35:54 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:35:54 user nova-compute[71507]:     <system>
Apr 13 15:35:54 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:35:54 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:35:54 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:35:54 user nova-compute[71507]:       <entry name="serial">a8e5dbae-1051-494e-9383-8d334bcd9f97</entry>
Apr 13 15:35:54 user nova-compute[71507]:       <entry name="uuid">a8e5dbae-1051-494e-9383-8d334bcd9f97</entry>
Apr 13 15:35:54 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:35:54 user nova-compute[71507]:     </system>
Apr 13 15:35:54 user nova-compute[71507]:   </sysinfo>
Apr 13 15:35:54 user nova-compute[71507]:   <os>
Apr 13 15:35:54 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:35:54 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:35:54 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:35:54 user nova-compute[71507]:   </os>
Apr 13 15:35:54 user nova-compute[71507]:   <features>
Apr 13 15:35:54 user nova-compute[71507]:     <acpi/>
Apr 13 15:35:54 user nova-compute[71507]:     <apic/>
Apr 13 15:35:54 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:35:54 user nova-compute[71507]:   </features>
Apr 13 15:35:54 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:35:54 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:35:54 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:35:54 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:35:54 user nova-compute[71507]:   </clock>
Apr 13 15:35:54 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:35:54 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:35:54 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:35:54 user nova-compute[71507]:   </cpu>
Apr 13 15:35:54 user nova-compute[71507]:   <devices>
Apr 13 15:35:54 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:35:54 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:35:54 user nova-compute[71507]:       <source dev="/dev/sdb"/>
Apr 13 15:35:54 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:35:54 user nova-compute[71507]:       <serial>b2fd9484-a7d6-4cb0-a5bb-01ef47449211</serial>
Apr 13 15:35:54 user nova-compute[71507]:     </disk>
Apr 13 15:35:54 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:35:54 user nova-compute[71507]:       <mac address="fa:16:3e:8d:b5:b2"/>
Apr 13 15:35:54 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:35:54 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:35:54 user nova-compute[71507]:       <target dev="tap68238072-78"/>
Apr 13 15:35:54 user nova-compute[71507]:     </interface>
Apr 13 15:35:54 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:35:54 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/a8e5dbae-1051-494e-9383-8d334bcd9f97/console.log" append="off"/>
Apr 13 15:35:54 user nova-compute[71507]:     </serial>
Apr 13 15:35:54 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:35:54 user nova-compute[71507]:     <video>
Apr 13 15:35:54 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:35:54 user nova-compute[71507]:     </video>
Apr 13 15:35:54 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:35:54 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:35:54 user nova-compute[71507]:     </rng>
Apr 13 15:35:54 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:35:54 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:35:54 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:35:54 user nova-compute[71507]:     </memballoon>
Apr 13 15:35:54 user nova-compute[71507]:   </devices>
Apr 13 15:35:54 user nova-compute[71507]: </domain>
Apr 13 15:35:54 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1243895427',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1243895427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1243895427',id=41,image_ref='a8b51e62-45b1-4f4a-b622-38c5e601bfd8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-9uw386vg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-374778702',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:35:43Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=a8e5dbae-1051-494e-9383-8d334bcd9f97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b5:b2,bridge_name='br-int',has_traffic_filtering=True,id=68238072-7820-4474-a63e-b28f6e9e9d86,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68238072-78') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG os_vif [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b5:b2,bridge_name='br-int',has_traffic_filtering=True,id=68238072-7820-4474-a63e-b28f6e9e9d86,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68238072-78') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68238072-78, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68238072-78, col_values=(('external_ids', {'iface-id': '68238072-7820-4474-a63e-b28f6e9e9d86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:b5:b2', 'vm-uuid': 'a8e5dbae-1051-494e-9383-8d334bcd9f97'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:35:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:54 user nova-compute[71507]: INFO os_vif [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b5:b2,bridge_name='br-int',has_traffic_filtering=True,id=68238072-7820-4474-a63e-b28f6e9e9d86,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68238072-78')
Apr 13 15:35:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:35:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No VIF found with MAC fa:16:3e:8d:b5:b2, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:35:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received event network-vif-plugged-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] Acquiring lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] No waiting events found dispatching network-vif-plugged-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:56 user nova-compute[71507]: WARNING nova.compute.manager [req-8d2a06c2-bd4f-4e84-bc7d-a8537554f6e1 req-00b7a267-6713-471b-9d7c-8da866e7206e service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received unexpected event network-vif-plugged-68238072-7820-4474-a63e-b28f6e9e9d86 for instance with vm_state building and task_state spawning.
Apr 13 15:35:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400158.560707, a8e5dbae-1051-494e-9383-8d334bcd9f97 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:35:58 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] VM Resumed (Lifecycle Event)
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:35:58 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Instance spawned successfully.
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received event network-vif-plugged-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] Acquiring lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] No waiting events found dispatching network-vif-plugged-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:35:58 user nova-compute[71507]: WARNING nova.compute.manager [req-44e3df66-f471-424f-88aa-5c10a686c5b8 req-4b91ff43-3a0a-4dd9-a8f5-080bcaca2ca9 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received unexpected event network-vif-plugged-68238072-7820-4474-a63e-b28f6e9e9d86 for instance with vm_state building and task_state spawning.
Apr 13 15:35:58 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400158.561977, a8e5dbae-1051-494e-9383-8d334bcd9f97 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:35:58 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] VM Started (Lifecycle Event)
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:35:58 user nova-compute[71507]: INFO nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Took 5.20 seconds to spawn the instance on the hypervisor.
Apr 13 15:35:58 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:35:58 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:35:58 user nova-compute[71507]: INFO nova.compute.manager [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Took 16.27 seconds to build instance.
Apr 13 15:35:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-cb491a75-a9db-4e89-a38e-602d8be6935d tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.378s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:35:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:20 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:31 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:36:31 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:36:31 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:36:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:36:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:36:31 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:36:31 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid 362ab343-a3a0-46e0-a0a7-c25e60133227 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:36:32 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Updating instance_info_cache with network_info: [{"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:36:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-362ab343-a3a0-46e0-a0a7-c25e60133227" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:36:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:36:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:39 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:40 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:36:41 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:36:42 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:36:42 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=26.11536407470703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 32b179d3-712f-47bc-94ad-387c8ca77380 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance a8e5dbae-1051-494e-9383-8d334bcd9f97 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:36:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:36:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:45 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:36:45 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:36:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:36:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:36:49 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:36:49 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:36:50 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:36:51 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:36:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:36:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:36:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:36:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:36:54 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:36:59 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:37:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:37:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:37:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:37:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:09 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:14 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:37:19 user nova-compute[71507]: INFO nova.compute.claims [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Claim successful on node user
Apr 13 15:37:19 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG nova.network.neutron [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:37:19 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:37:19 user nova-compute[71507]: DEBUG nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG nova.policy [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af0f7d9513b44bda8e53597cf7751ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc833ca51a84b6789f0def7357d4c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:37:19 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:37:20 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Creating image(s)
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "/opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "/opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "/opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.128s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk 1073741824" returned: 0 in 0.046s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Cannot resize image /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG nova.objects.instance [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'migration_context' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Ensure instance console log exists: /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Successfully created port: bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:37:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Successfully updated port: bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:37:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:37:21 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquired lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:37:21 user nova-compute[71507]: DEBUG nova.network.neutron [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received event network-changed-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.compute.manager [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Refreshing instance network info cache due to event network-changed-bee671f2-48c8-41d0-945c-3c8b796aa286. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] Acquiring lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.network.neutron [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating instance_info_cache with network_info: [{"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Releasing lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Instance network_info: |[{"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] Acquired lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.network.neutron [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Refreshing network info cache for port bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Start _get_guest_xml network_info=[{"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:37:22 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:37:22 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1899978738',display_name='tempest-SnapshotDataIntegrityTests-server-1899978738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1899978738',id=43,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1KlcmjH08ASB6EGqoWCNiRIccnybruptZ8sbR1PLZTq358S36cyJUgy4qa0Lb0HyrKahfHVxBpwpLbc5x22ZY4G+mKj9Fadjm1HmD3fWxrE1krMESQzmxfti/1t4bU2w==',key_name='tempest-SnapshotDataIntegrityTests-1169680877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fc833ca51a84b6789f0def7357d4c59',ramdisk_id='',reservation_id='r-qn3xdg0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-965824759',owner_user_name='tempest-SnapshotDataIntegrityTests-965824759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:37:20Z,user_data=None,user_id='af0f7d9513b44bda8e53597cf7751ec0',uuid=dccdbfbe-1261-490e-b8bf-b06e46d42f37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Converting VIF {"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:92:0d,bridge_name='br-int',has_traffic_filtering=True,id=bee671f2-48c8-41d0-945c-3c8b796aa286,network=Network(1f6973b5-16ba-4e7b-ac56-dff73d570d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee671f2-48') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.objects.instance [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'pci_devices' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:37:22 user nova-compute[71507]:   <uuid>dccdbfbe-1261-490e-b8bf-b06e46d42f37</uuid>
Apr 13 15:37:22 user nova-compute[71507]:   <name>instance-0000002b</name>
Apr 13 15:37:22 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:37:22 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:37:22 user nova-compute[71507]:   <metadata>
Apr 13 15:37:22 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:37:22 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:37:22 user nova-compute[71507]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1899978738</nova:name>
Apr 13 15:37:22 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:37:22</nova:creationTime>
Apr 13 15:37:22 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:37:22 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:37:22 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:37:22 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:37:22 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:37:22 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:37:22 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:37:22 user nova-compute[71507]:       <nova:owner>
Apr 13 15:37:22 user nova-compute[71507]:         <nova:user uuid="af0f7d9513b44bda8e53597cf7751ec0">tempest-SnapshotDataIntegrityTests-965824759-project-member</nova:user>
Apr 13 15:37:22 user nova-compute[71507]:         <nova:project uuid="3fc833ca51a84b6789f0def7357d4c59">tempest-SnapshotDataIntegrityTests-965824759</nova:project>
Apr 13 15:37:22 user nova-compute[71507]:       </nova:owner>
Apr 13 15:37:22 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:37:22 user nova-compute[71507]:       <nova:ports>
Apr 13 15:37:22 user nova-compute[71507]:         <nova:port uuid="bee671f2-48c8-41d0-945c-3c8b796aa286">
Apr 13 15:37:22 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 15:37:22 user nova-compute[71507]:         </nova:port>
Apr 13 15:37:22 user nova-compute[71507]:       </nova:ports>
Apr 13 15:37:22 user nova-compute[71507]:     </nova:instance>
Apr 13 15:37:22 user nova-compute[71507]:   </metadata>
Apr 13 15:37:22 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:37:22 user nova-compute[71507]:     <system>
Apr 13 15:37:22 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:37:22 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:37:22 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:37:22 user nova-compute[71507]:       <entry name="serial">dccdbfbe-1261-490e-b8bf-b06e46d42f37</entry>
Apr 13 15:37:22 user nova-compute[71507]:       <entry name="uuid">dccdbfbe-1261-490e-b8bf-b06e46d42f37</entry>
Apr 13 15:37:22 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:37:22 user nova-compute[71507]:     </system>
Apr 13 15:37:22 user nova-compute[71507]:   </sysinfo>
Apr 13 15:37:22 user nova-compute[71507]:   <os>
Apr 13 15:37:22 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:37:22 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:37:22 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:37:22 user nova-compute[71507]:   </os>
Apr 13 15:37:22 user nova-compute[71507]:   <features>
Apr 13 15:37:22 user nova-compute[71507]:     <acpi/>
Apr 13 15:37:22 user nova-compute[71507]:     <apic/>
Apr 13 15:37:22 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:37:22 user nova-compute[71507]:   </features>
Apr 13 15:37:22 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:37:22 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:37:22 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:37:22 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:37:22 user nova-compute[71507]:   </clock>
Apr 13 15:37:22 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:37:22 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:37:22 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:37:22 user nova-compute[71507]:   </cpu>
Apr 13 15:37:22 user nova-compute[71507]:   <devices>
Apr 13 15:37:22 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:37:22 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:37:22 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk"/>
Apr 13 15:37:22 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:37:22 user nova-compute[71507]:     </disk>
Apr 13 15:37:22 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:37:22 user nova-compute[71507]:       <mac address="fa:16:3e:db:92:0d"/>
Apr 13 15:37:22 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:37:22 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:37:22 user nova-compute[71507]:       <target dev="tapbee671f2-48"/>
Apr 13 15:37:22 user nova-compute[71507]:     </interface>
Apr 13 15:37:22 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:37:22 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/console.log" append="off"/>
Apr 13 15:37:22 user nova-compute[71507]:     </serial>
Apr 13 15:37:22 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:37:22 user nova-compute[71507]:     <video>
Apr 13 15:37:22 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:37:22 user nova-compute[71507]:     </video>
Apr 13 15:37:22 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:37:22 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:37:22 user nova-compute[71507]:     </rng>
Apr 13 15:37:22 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:37:22 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:37:22 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:37:22 user nova-compute[71507]:     </memballoon>
Apr 13 15:37:22 user nova-compute[71507]:   </devices>
Apr 13 15:37:22 user nova-compute[71507]: </domain>
Apr 13 15:37:22 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1899978738',display_name='tempest-SnapshotDataIntegrityTests-server-1899978738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1899978738',id=43,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1KlcmjH08ASB6EGqoWCNiRIccnybruptZ8sbR1PLZTq358S36cyJUgy4qa0Lb0HyrKahfHVxBpwpLbc5x22ZY4G+mKj9Fadjm1HmD3fWxrE1krMESQzmxfti/1t4bU2w==',key_name='tempest-SnapshotDataIntegrityTests-1169680877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fc833ca51a84b6789f0def7357d4c59',ramdisk_id='',reservation_id='r-qn3xdg0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-965824759',owner_user_name='tempest-SnapshotDataIntegrityTests-965824759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:37:20Z,user_data=None,user_id='af0f7d9513b44bda8e53597cf7751ec0',uuid=dccdbfbe-1261-490e-b8bf-b06e46d42f37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Converting VIF {"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:92:0d,bridge_name='br-int',has_traffic_filtering=True,id=bee671f2-48c8-41d0-945c-3c8b796aa286,network=Network(1f6973b5-16ba-4e7b-ac56-dff73d570d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee671f2-48') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG os_vif [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:92:0d,bridge_name='br-int',has_traffic_filtering=True,id=bee671f2-48c8-41d0-945c-3c8b796aa286,network=Network(1f6973b5-16ba-4e7b-ac56-dff73d570d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee671f2-48') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbee671f2-48, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbee671f2-48, col_values=(('external_ids', {'iface-id': 'bee671f2-48c8-41d0-945c-3c8b796aa286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:92:0d', 'vm-uuid': 'dccdbfbe-1261-490e-b8bf-b06e46d42f37'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:22 user nova-compute[71507]: INFO os_vif [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:92:0d,bridge_name='br-int',has_traffic_filtering=True,id=bee671f2-48c8-41d0-945c-3c8b796aa286,network=Network(1f6973b5-16ba-4e7b-ac56-dff73d570d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee671f2-48')
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No VIF found with MAC fa:16:3e:db:92:0d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.network.neutron [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updated VIF entry in instance network info cache for port bee671f2-48c8-41d0-945c-3c8b796aa286. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG nova.network.neutron [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating instance_info_cache with network_info: [{"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:37:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3bac8bfb-3855-4f08-a4c6-256bf4642e09 req-1876da56-c5db-479d-9871-fbe6ba25b778 service nova] Releasing lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:37:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received event network-vif-plugged-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] No waiting events found dispatching network-vif-plugged-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:37:24 user nova-compute[71507]: WARNING nova.compute.manager [req-691a86e1-8fbd-495d-8249-b99981ab3e16 req-9115c417-9304-4daf-8b09-2c73b83d1cc0 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received unexpected event network-vif-plugged-bee671f2-48c8-41d0-945c-3c8b796aa286 for instance with vm_state building and task_state spawning.
Apr 13 15:37:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:24 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400245.8872843, dccdbfbe-1261-490e-b8bf-b06e46d42f37 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:37:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] VM Resumed (Lifecycle Event)
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:37:25 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Instance spawned successfully.
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:37:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400245.8911524, dccdbfbe-1261-490e-b8bf-b06e46d42f37 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:37:25 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] VM Started (Lifecycle Event)
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:37:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:37:26 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:37:26 user nova-compute[71507]: INFO nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Took 6.01 seconds to spawn the instance on the hypervisor.
Apr 13 15:37:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:37:26 user nova-compute[71507]: INFO nova.compute.manager [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Took 6.64 seconds to build instance.
Apr 13 15:37:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-22074927-cbb9-4e7e-bd05-ee0c4bb21fce tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.730s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received event network-vif-plugged-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] No waiting events found dispatching network-vif-plugged-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:37:26 user nova-compute[71507]: WARNING nova.compute.manager [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received unexpected event network-vif-plugged-bee671f2-48c8-41d0-945c-3c8b796aa286 for instance with vm_state active and task_state None.
Apr 13 15:37:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-changed-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Refreshing instance network info cache due to event network-changed-1cb2ae52-e4fa-4627-b3f3-301af5732358. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Acquiring lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Acquired lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Refreshing network info cache for port 1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updated VIF entry in instance network info cache for port 1cb2ae52-e4fa-4627-b3f3-301af5732358. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:37:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-11431b36-c143-48ce-b1ba-306ebf11fcdc req-f5cf8ca8-d78e-4bc4-82d0-9f59bb68ccd3 service nova] Releasing lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:37:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:29 user nova-compute[71507]: INFO nova.compute.manager [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Shelving
Apr 13 15:37:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:30 user nova-compute[71507]: DEBUG nova.compute.manager [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-unplugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:30 user nova-compute[71507]: DEBUG nova.compute.manager [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] No waiting events found dispatching network-vif-unplugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:37:30 user nova-compute[71507]: WARNING nova.compute.manager [req-6365a50a-4562-475a-ae6d-7e77f7d8c7c7 req-7b8c919c-6198-4842-88e7-92a623aa8789 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received unexpected event network-vif-unplugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance with vm_state active and task_state shelving.
Apr 13 15:37:30 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance destroyed successfully.
Apr 13 15:37:30 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Beginning cold snapshot process
Apr 13 15:37:31 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:37:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk /opt/stack/data/nova/instances/snapshots/tmp0kv2zf4g/b8e32b86179843fa83587f87f6e1de51 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:31 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:31 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:37:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:37:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:37:31 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:37:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk /opt/stack/data/nova/instances/snapshots/tmp0kv2zf4g/b8e32b86179843fa83587f87f6e1de51" returned: 0 in 0.676s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:31 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Snapshot extracted, beginning image upload
Apr 13 15:37:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:32 user nova-compute[71507]: DEBUG nova.compute.manager [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] No waiting events found dispatching network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:37:32 user nova-compute[71507]: WARNING nova.compute.manager [req-5d0985f5-1171-4341-9bb0-494b69790c94 req-28f9af2c-959c-4569-b6fa-b6d742f5109f service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received unexpected event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 15:37:32 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:37:32 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:37:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:37:32 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "a8e5dbae-1051-494e-9383-8d334bcd9f97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:33 user nova-compute[71507]: INFO nova.compute.manager [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Terminating instance
Apr 13 15:37:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received event network-vif-unplugged-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] Acquiring lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] No waiting events found dispatching network-vif-unplugged-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-ffd25483-b83d-4223-a4b6-ed51d62eccda req-c3c83c13-c17e-4658-b5da-db08963f18e3 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received event network-vif-unplugged-68238072-7820-4474-a63e-b28f6e9e9d86 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Instance destroyed successfully.
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'resources' on Instance uuid a8e5dbae-1051-494e-9383-8d334bcd9f97 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1243895427',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1243895427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1243895427',id=41,image_ref='a8b51e62-45b1-4f4a-b622-38c5e601bfd8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:35:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-9uw386vg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-374778702',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:35:59Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=a8e5dbae-1051-494e-9383-8d334bcd9f97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "68238072-7820-4474-a63e-b28f6e9e9d86", "address": "fa:16:3e:8d:b5:b2", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68238072-78", "ovs_interfaceid": "68238072-7820-4474-a63e-b28f6e9e9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b5:b2,bridge_name='br-int',has_traffic_filtering=True,id=68238072-7820-4474-a63e-b28f6e9e9d86,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68238072-78') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_vif [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b5:b2,bridge_name='br-int',has_traffic_filtering=True,id=68238072-7820-4474-a63e-b28f6e9e9d86,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68238072-78') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68238072-78, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:34 user nova-compute[71507]: INFO os_vif [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b5:b2,bridge_name='br-int',has_traffic_filtering=True,id=68238072-7820-4474-a63e-b28f6e9e9d86,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68238072-78')
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SgHNGdue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:37:34 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ba6f5a-73d6-4c1c-9c2c-6876beadb254]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:37:34 user nova-compute[71507]: No targets found.
Apr 13 15:37:34 user nova-compute[71507]: iSNS:
Apr 13 15:37:34 user nova-compute[71507]: No targets found.
Apr 13 15:37:34 user nova-compute[71507]: STATIC:
Apr 13 15:37:34 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb
Apr 13 15:37:34 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:37:34 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:37:34 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211
Apr 13 15:37:34 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:37:34 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:37:34 user nova-compute[71507]: FIRMWARE:
Apr 13 15:37:34 user nova-compute[71507]: No targets found.
Apr 13 15:37:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:37:34 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:37:34 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Snapshot image upload complete
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd63145-1624-4a92-9b4a-fc58783b7e67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bf6403-4080-46ef-aeb3-3476492a6ae6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:37:34 user nova-compute[71507]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 (non-flash)
Apr 13 15:37:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:37:34 user nova-compute[71507]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 (non-flash)
Apr 13 15:37:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c4685e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce1a2d0-c77a-45ea-9910-ce745827e450]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: INFO nova.compute.manager [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Shelve offloading
Apr 13 15:37:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance destroyed successfully.
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb72ec5-adf1-45af-9260-6a63827242a7]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquired lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2d412c-8f9e-4859-9e64-e67444feb96f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda159a9-b8cf-4d1b-884c-5c862ef2d814]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO393c0f29-070822972fe1bfb3', '/dev/disk/by-id/scsi-23037303832323937', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_393c0f29') {{(pid=81901) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a617250-54b4-4d98-ad4a-cb21548b9365]: (4, None) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9b00e8-99a0-4939-a00c-bda91a334d92]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93a4a4f-2e5d-43b1-8a6d-08f1f5265ff1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211, portal: 172.16.0.220,3260]
Apr 13 15:37:34 user nova-compute[71507]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211, portal: 172.16.0.220,3260] successful.
Apr 13 15:37:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fd9484-a7d6-4cb0-a5bb-01ef47449211 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5cdaeb-ed97-450d-aa3c-e155eb33efc0]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== disconnect_volume: return (331ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:37:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Deleting instance files /opt/stack/data/nova/instances/a8e5dbae-1051-494e-9383-8d334bcd9f97_del
Apr 13 15:37:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Deletion of /opt/stack/data/nova/instances/a8e5dbae-1051-494e-9383-8d334bcd9f97_del complete
Apr 13 15:37:34 user nova-compute[71507]: INFO nova.compute.manager [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Releasing lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:37:34 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:37:34 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Took 0.47 seconds to deallocate network for instance.
Apr 13 15:37:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance destroyed successfully.
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'resources' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1461623425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1461623425',id=40,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnB1XKsk+V/s+8svM9sTYLSdCjPIha2/SxAlkQCj7RRjLtDmMIHKWKDxVW7nV/0+Ei3Tt4l3pDA6FtDGaEcY6JOCIXBZUCsdZhUWv5y0PmkdIGRBBVocQPBaKYwc7DDpg==',key_name='tempest-keypair-249143367',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-iqgyjdxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member',shelved_at='2023-04-13T15:37:34.118045',shelved_host='user',shelved_image_id='444c3871-8575-4487-b66c-a8f21ab0541d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=32b179d3-712f-47bc-94ad-387c8ca77380,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG os_vif [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cb2ae52-e4, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:37:35 user nova-compute[71507]: INFO os_vif [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4')
Apr 13 15:37:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Deleting instance files /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380_del
Apr 13 15:37:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Deletion of /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380_del complete
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-changed-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Refreshing instance network info cache due to event network-changed-1cb2ae52-e4fa-4627-b3f3-301af5732358. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] Acquiring lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] Acquired lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.network.neutron [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Refreshing network info cache for port 1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:37:35 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Deleted allocations for instance 32b179d3-712f-47bc-94ad-387c8ca77380
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received event network-vif-plugged-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] Acquiring lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] No waiting events found dispatching network-vif-plugged-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:37:35 user nova-compute[71507]: WARNING nova.compute.manager [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received unexpected event network-vif-plugged-68238072-7820-4474-a63e-b28f6e9e9d86 for instance with vm_state active and task_state deleting.
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-0fd8df23-cb3b-465b-a06e-512d1e44866f req-78134d31-cd43-4323-a8bc-662be24dbec9 service nova] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Received event network-vif-deleted-68238072-7820-4474-a63e-b28f6e9e9d86 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'numa_topology' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:37:35 user nova-compute[71507]: INFO nova.compute.manager [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Took 0.85 seconds to detach 1 volumes for instance.
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Deleting volume: b2fd9484-a7d6-4cb0-a5bb-01ef47449211 {{(pid=71507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.network.neutron [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updated VIF entry in instance network info cache for port 1cb2ae52-e4fa-4627-b3f3-301af5732358. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG nova.network.neutron [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-4b92833a-fb0c-4147-acfe-b45d558e2b2c req-9c403d62-760b-4c1e-9146-0e920f23e66d service nova] Releasing lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d9359cf6-dc54-470e-9370-21f7dad1954d tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.363s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:36 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:37:36 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:37:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:36 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Deleted allocations for instance a8e5dbae-1051-494e-9383-8d334bcd9f97
Apr 13 15:37:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b4cc6651-3b23-4337-9095-74e87c2f710c tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "a8e5dbae-1051-494e-9383-8d334bcd9f97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.956s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG nova.objects.instance [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'flavor' on Instance uuid b2ed660b-7c9a-4a67-a48c-9bbbacc046bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:37:37 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Ignoring supplied device name: /dev/vdb
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:37 user nova-compute[71507]: INFO nova.compute.manager [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Attaching volume 8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea to /dev/vdb
Apr 13 15:37:37 user nova-compute[71507]: DEBUG os_brick.utils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ded859-4290-408d-a153-58471ac23bd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e9f086-7343-4368-afa9-1685062426d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[372625f1-583f-46fe-a50f-808b0abadcfe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d24210-b8ba-4797-81e4-d93fdd254b65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:37:38 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:37:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf001e4-4fca-4d31-8a9a-d93e3406181c]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG os_brick.utils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Updating existing volume attachment record: 8e6ba6f5-f7fc-4f5b-bf0f-e7b24c8e0c1b {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:37:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:40 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNeOcfdW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:37:43 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:37:43 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:37:43 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:37:43 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8493MB free_disk=26.067371368408203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[344fb23b-119b-49c7-9b86-0a06f2a72216]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:37:43 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb63a19a-f5b8-4f94-bbcb-9b633a5debeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea] added
Apr 13 15:37:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9c455c-608d-4011-b1e3-5bda9db56c32]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[59407d23-6e83-49dc-8350-6ed56f070f3f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 362ab343-a3a0-46e0-a0a7-c25e60133227 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNeOcfdW {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNeOcfdW" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c99d34-0ee9-4e80-9849-00b5c0e627f0]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xNeOcfdW'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8533c19b-7c8e-40d4-a119-793c080ef29a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8fe26c-aa1e-4ce8-a52d-f89ef8465552]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:37:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:37:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b52621-fa74-47c6-834e-6fcb7f91ea9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea, portal: 172.16.0.220,3260]
Apr 13 15:37:43 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea, portal: 172.16.0.220,3260] successful.
Apr 13 15:37:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a5aa3-90a2-4876-a4c5-c964e23ff3a4]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e75bc32-3408-4f5e-8472-9403d3c58927]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:37:43 user nova-compute[71507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea (non-flash)
Apr 13 15:37:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:37:43 user nova-compute[71507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea (non-flash)
Apr 13 15:37:43 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:37:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:37:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:37:44 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91d4fff-104d-43d2-a062-69ddbfd823ed]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:37:44 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNeOcfdW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23262373063313234', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262373063313234', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG nova.objects.instance [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'flavor' on Instance uuid b2ed660b-7c9a-4a67-a48c-9bbbacc046bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:37:45 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:37:45 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:37:45 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:37:45 user nova-compute[71507]:   <serial>8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea</serial>
Apr 13 15:37:45 user nova-compute[71507]: </disk>
Apr 13 15:37:45 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400250.3367364, 32b179d3-712f-47bc-94ad-387c8ca77380 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:37:45 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] VM Stopped (Lifecycle Event)
Apr 13 15:37:45 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a12f96d1-7605-4e54-b4a3-d960f7291214 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No VIF found with MAC fa:16:3e:35:54:f1, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:37:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-753381cc-1680-4fee-b9cb-2fc55dc76db0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.785s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:37:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:37:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:48 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:48 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400253.9968612, a8e5dbae-1051-494e-9383-8d334bcd9f97 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:37:48 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] VM Stopped (Lifecycle Event)
Apr 13 15:37:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-1b9c5321-0cc8-4312-b11b-d7e0bc16e611 None None] [instance: a8e5dbae-1051-494e-9383-8d334bcd9f97] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:37:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:51 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:51 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:37:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:37:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:37:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:37:59 user nova-compute[71507]: INFO nova.compute.manager [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Detaching volume 8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea
Apr 13 15:37:59 user nova-compute[71507]: INFO nova.virt.block_device [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Attempting to driver detach volume 8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea from mountpoint /dev/vdb
Apr 13 15:37:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Attempting to detach device vdb from instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:37:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:37:59 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:37:59 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:37:59 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:37:59 user nova-compute[71507]:   <serial>8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea</serial>
Apr 13 15:37:59 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:37:59 user nova-compute[71507]: </disk>
Apr 13 15:37:59 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:37:59 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Successfully detached device vdb from instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd from the persistent domain config.
Apr 13 15:37:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:37:59 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:37:59 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:37:59 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:37:59 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:37:59 user nova-compute[71507]:   <serial>8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea</serial>
Apr 13 15:37:59 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:37:59 user nova-compute[71507]: </disk>
Apr 13 15:37:59 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681400280.3458798, b2ed660b-7c9a-4a67-a48c-9bbbacc046bd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:38:00 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Successfully detached device vdb from instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd from the live domain config.
Apr 13 15:38:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNeOcfdW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:38:00 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[80768758-90c7-4b81-aaa6-737f996396b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:38:00 user nova-compute[71507]: No targets found.
Apr 13 15:38:00 user nova-compute[71507]: iSNS:
Apr 13 15:38:00 user nova-compute[71507]: No targets found.
Apr 13 15:38:00 user nova-compute[71507]: STATIC:
Apr 13 15:38:00 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea
Apr 13 15:38:00 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:38:00 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:38:00 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb
Apr 13 15:38:00 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:38:00 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:38:00 user nova-compute[71507]: FIRMWARE:
Apr 13 15:38:00 user nova-compute[71507]: No targets found.
Apr 13 15:38:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:38:00 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:38:00 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd563f3-720d-4370-a0b4-e82fd772bee5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[57411362-db54-435b-83a3-44e9772388f9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:38:00 user nova-compute[71507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea (non-flash)
Apr 13 15:38:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:38:00 user nova-compute[71507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea (non-flash)
Apr 13 15:38:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab142296c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9c11e1-4c45-4821-90aa-1dde047cd449]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab67b86b-9253-4c7f-a819-ec2735d2a6aa]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35acba1-b653-41b3-8f63-92b1ae7a6ce5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3a8115-f889-49c0-b876-f30ffef46c6a]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[46453f6c-b304-4260-aedb-7ad6b6051a60]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb89a4ab-17c6-44c1-a57e-45dda40425fe]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea, portal: 172.16.0.220,3260]
Apr 13 15:38:00 user nova-compute[71507]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea, portal: 172.16.0.220,3260] successful.
Apr 13 15:38:00 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff1c33-e811-4e91-ab93-f3f3935abbb7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] <== disconnect_volume: return (303ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:38:00 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'flavor' on Instance uuid b2ed660b-7c9a-4a67-a48c-9bbbacc046bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e935af05-9526-4c4f-ae67-3cde861e08b0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.605s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.422s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:01 user nova-compute[71507]: INFO nova.compute.manager [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Terminating instance
Apr 13 15:38:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received event network-vif-unplugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] No waiting events found dispatching network-vif-unplugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG nova.compute.manager [req-3739d9b4-ef08-4588-a109-bf0bed693f69 req-ff692c7c-fa38-4015-a918-b883dd03d339 service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received event network-vif-unplugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:38:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:02 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Instance destroyed successfully.
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.objects.instance [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'resources' on Instance uuid b2ed660b-7c9a-4a67-a48c-9bbbacc046bd {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-269338813',display_name='tempest-VolumesSnapshotTestJSON-instance-269338813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-269338813',id=42,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:35:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0a40f5a9b5e4f3fb8467b6ea304bbe5',ramdisk_id='',reservation_id='r-ct1123ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-392588653',owner_user_name='tempest-VolumesSnapshotTestJSON-392588653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:35:54Z,user_data=None,user_id='300cbdea17c74a418f50e2d581691ad3',uuid=b2ed660b-7c9a-4a67-a48c-9bbbacc046bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converting VIF {"id": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "address": "fa:16:3e:35:54:f1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9dc5c9c-85", "ovs_interfaceid": "d9dc5c9c-85d3-406a-be61-8f3cc9354712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:f1,bridge_name='br-int',has_traffic_filtering=True,id=d9dc5c9c-85d3-406a-be61-8f3cc9354712,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc5c9c-85') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_vif [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:f1,bridge_name='br-int',has_traffic_filtering=True,id=d9dc5c9c-85d3-406a-be61-8f3cc9354712,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc5c9c-85') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9dc5c9c-85, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:38:02 user nova-compute[71507]: INFO os_vif [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:f1,bridge_name='br-int',has_traffic_filtering=True,id=d9dc5c9c-85d3-406a-be61-8f3cc9354712,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9dc5c9c-85')
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNeOcfdW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:38:02 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a57eabd-f652-4d69-9596-3c62a39bf0e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:38:02 user nova-compute[71507]: No targets found.
Apr 13 15:38:02 user nova-compute[71507]: iSNS:
Apr 13 15:38:02 user nova-compute[71507]: No targets found.
Apr 13 15:38:02 user nova-compute[71507]: STATIC:
Apr 13 15:38:02 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb
Apr 13 15:38:02 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:38:02 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:38:02 user nova-compute[71507]: FIRMWARE:
Apr 13 15:38:02 user nova-compute[71507]: No targets found.
Apr 13 15:38:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:38:02 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:38:02 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f49fc3c-f8b9-43f1-bce8-0b2fba8300ea', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7777e2-c9aa-4cca-a9e5-c21d5a30622d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[198f8305-521e-47e0-949e-0139b6e23371]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:38:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:38:02 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faaf0577e20>, {}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Disconnecting from: [] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] <== disconnect_volume: return (67ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:38:02 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Deleting instance files /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd_del
Apr 13 15:38:02 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Deletion of /opt/stack/data/nova/instances/b2ed660b-7c9a-4a67-a48c-9bbbacc046bd_del complete
Apr 13 15:38:02 user nova-compute[71507]: INFO nova.compute.manager [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:38:02 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Took 0.46 seconds to deallocate network for instance.
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received event network-vif-deleted-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:38:02 user nova-compute[71507]: INFO nova.compute.manager [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Neutron deleted interface d9dc5c9c-85d3-406a-be61-8f3cc9354712; detaching it from the instance and deleting it from the info cache
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.network.neutron [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-a73b0dd6-4508-4840-81a1-a63d3913f0aa req-9d5122cd-7291-4741-b7b2-5628369626cc service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Detach interface failed, port_id=d9dc5c9c-85d3-406a-be61-8f3cc9354712, reason: Instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:38:02 user nova-compute[71507]: WARNING nova.volume.cinder [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Attachment 8e6ba6f5-f7fc-4f5b-bf0f-e7b24c8e0c1b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8e6ba6f5-f7fc-4f5b-bf0f-e7b24c8e0c1b. (HTTP 404) (Request-ID: req-924bf295-f187-4a9c-b776-c1390c65ac4c)
Apr 13 15:38:02 user nova-compute[71507]: INFO nova.compute.manager [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Took 0.03 seconds to detach 1 volumes for instance.
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:03 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:38:03 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:38:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:03 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Deleted allocations for instance b2ed660b-7c9a-4a67-a48c-9bbbacc046bd
Apr 13 15:38:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-661b96c0-d3ff-4e3f-806c-41659f4a62a0 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.734s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received event network-vif-plugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:38:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] Acquiring lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] Lock "b2ed660b-7c9a-4a67-a48c-9bbbacc046bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:03 user nova-compute[71507]: DEBUG nova.compute.manager [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] No waiting events found dispatching network-vif-plugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:38:03 user nova-compute[71507]: WARNING nova.compute.manager [req-47c5685f-434e-4e9b-b2e3-7a6304e8a6d8 req-f1904a8a-8789-4f70-ab83-b34d9b2a3e3b service nova] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Received unexpected event network-vif-plugged-d9dc5c9c-85d3-406a-be61-8f3cc9354712 for instance with vm_state deleted and task_state None.
Apr 13 15:38:07 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:17 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400282.1888373, b2ed660b-7c9a-4a67-a48c-9bbbacc046bd => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:38:17 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] VM Stopped (Lifecycle Event)
Apr 13 15:38:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-a80fc67c-6b48-43cf-91ee-abb89fe44cfa None None] [instance: b2ed660b-7c9a-4a67-a48c-9bbbacc046bd] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:38:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:38:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:38:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:22 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "362ab343-a3a0-46e0-a0a7-c25e60133227" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:25 user nova-compute[71507]: INFO nova.compute.manager [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Terminating instance
Apr 13 15:38:25 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:38:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:25 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Instance destroyed successfully.
Apr 13 15:38:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG nova.objects.instance [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'resources' on Instance uuid 362ab343-a3a0-46e0-a0a7-c25e60133227 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2134972973',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2134972973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2134972973',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-lxogsjd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:33:58Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=362ab343-a3a0-46e0-a0a7-c25e60133227,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "b70334b8-70db-4e5e-b2c9-11b514210eef", "address": "fa:16:3e:0d:80:ee", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70334b8-70", "ovs_interfaceid": "b70334b8-70db-4e5e-b2c9-11b514210eef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:80:ee,bridge_name='br-int',has_traffic_filtering=True,id=b70334b8-70db-4e5e-b2c9-11b514210eef,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70334b8-70') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_vif [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:80:ee,bridge_name='br-int',has_traffic_filtering=True,id=b70334b8-70db-4e5e-b2c9-11b514210eef,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70334b8-70') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb70334b8-70, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:26 user nova-compute[71507]: INFO os_vif [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:80:ee,bridge_name='br-int',has_traffic_filtering=True,id=b70334b8-70db-4e5e-b2c9-11b514210eef,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70334b8-70')
Apr 13 15:38:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuFlTvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:38:26 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0e0c9f-3d03-4585-abdb-28ce4fbec57e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:38:26 user nova-compute[71507]: No targets found.
Apr 13 15:38:26 user nova-compute[71507]: iSNS:
Apr 13 15:38:26 user nova-compute[71507]: No targets found.
Apr 13 15:38:26 user nova-compute[71507]: STATIC:
Apr 13 15:38:26 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb
Apr 13 15:38:26 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:38:26 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:38:26 user nova-compute[71507]: FIRMWARE:
Apr 13 15:38:26 user nova-compute[71507]: No targets found.
Apr 13 15:38:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:38:26 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:38:26 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bd693a-7f4a-428a-941d-e1bedab00d2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9080e14d-ce06-4590-ae2f-b8886f89bf79]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:38:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb (non-flash)
Apr 13 15:38:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c0c3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2500498-db97-418c-a41c-7c29623f49a3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fc31c2-8a3a-480a-b376-ecc3a929402b]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48f1a81-caab-4072-b418-73eec1184e63]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d17c149-e5f2-4345-9390-42436d0fc54b]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received event network-vif-unplugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] Acquiring lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] No waiting events found dispatching network-vif-unplugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f1f84ce-e1c0-4c7c-bedd-1d6ed4ded5f2 req-26e859dc-751b-4370-aec8-8d4d1041cf1a service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received event network-vif-unplugged-b70334b8-70db-4e5e-b2c9-11b514210eef for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[568c5330-6b34-4f12-8384-b5167d24c6dd]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7777e14e-ecc6-4b27-8c47-2536177f0f41]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb, portal: 172.16.0.220,3260]
Apr 13 15:38:26 user nova-compute[71507]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb, portal: 172.16.0.220,3260] successful.
Apr 13 15:38:26 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f5cd6-04ae-41af-8266-365985d19beb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d470d2fc-9db8-45cd-b92f-0fe99cf4850f]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== disconnect_volume: return (333ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:38:26 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:38:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Deleting instance files /opt/stack/data/nova/instances/362ab343-a3a0-46e0-a0a7-c25e60133227_del
Apr 13 15:38:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Deletion of /opt/stack/data/nova/instances/362ab343-a3a0-46e0-a0a7-c25e60133227_del complete
Apr 13 15:38:27 user nova-compute[71507]: INFO nova.compute.manager [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 13 15:38:27 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:38:27 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:38:27 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:38:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:27 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:27 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:38:27 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Took 0.83 seconds to deallocate network for instance.
Apr 13 15:38:28 user nova-compute[71507]: INFO nova.compute.manager [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Took 0.74 seconds to detach 1 volumes for instance.
Apr 13 15:38:28 user nova-compute[71507]: DEBUG nova.compute.manager [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Deleting volume: 662f5cd6-04ae-41af-8266-365985d19beb {{(pid=71507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:28 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Deleted allocations for instance 362ab343-a3a0-46e0-a0a7-c25e60133227
Apr 13 15:38:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received event network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Acquiring lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] No waiting events found dispatching network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:38:28 user nova-compute[71507]: WARNING nova.compute.manager [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received unexpected event network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef for instance with vm_state deleted and task_state None.
Apr 13 15:38:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received event network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Acquiring lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] No waiting events found dispatching network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:38:28 user nova-compute[71507]: WARNING nova.compute.manager [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received unexpected event network-vif-plugged-b70334b8-70db-4e5e-b2c9-11b514210eef for instance with vm_state deleted and task_state None.
Apr 13 15:38:28 user nova-compute[71507]: DEBUG nova.compute.manager [req-06176664-87e0-4e89-813b-bbb3841fe882 req-72abd9f9-705b-4030-9435-3de85c592776 service nova] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Received event network-vif-deleted-b70334b8-70db-4e5e-b2c9-11b514210eef {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:38:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6a3e991b-51cb-4737-b691-8ef99866154e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "362ab343-a3a0-46e0-a0a7-c25e60133227" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.122s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:30 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances with incomplete migration  {{(pid=71507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 15:38:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:32 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:38:32 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:38:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:38:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:38:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:41 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400306.60901, 362ab343-a3a0-46e0-a0a7-c25e60133227 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:38:41 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] VM Stopped (Lifecycle Event)
Apr 13 15:38:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-efbfd836-f1e2-470e-a9f5-fcf314037190 None None] [instance: 362ab343-a3a0-46e0-a0a7-c25e60133227] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:38:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:38:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:38:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:38:42 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:38:43 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:38:43 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8584MB free_disk=26.084083557128906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing inventories for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating ProviderTree inventory for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing aggregate associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, aggregates: None {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Refreshing trait associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 15:38:43 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] There are 0 instances to clean {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 15:38:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:47 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:38:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:50 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:38:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:38:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:38:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:52 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:38:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:38:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:38:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:38:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:38:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:39:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:00 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:39:00 user nova-compute[71507]: INFO nova.compute.claims [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Claim successful on node user
Apr 13 15:39:00 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:39:00 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.network.neutron [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:39:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:39:01 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Creating image(s)
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "/opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "/opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "/opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.policy [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '300cbdea17c74a418f50e2d581691ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a40f5a9b5e4f3fb8467b6ea304bbe5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "07220e8de85ad46dae3aeb249f710a67925ee918" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.129s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918,backing_fmt=raw /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk 1073741824" returned: 0 in 0.049s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "07220e8de85ad46dae3aeb249f710a67925ee918" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk. size=1073741824 {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.virt.disk.api [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Cannot resize image /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk to a smaller size. {{(pid=71507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.objects.instance [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'migration_context' on Instance uuid 9da338fc-f979-4df6-b83e-8cb78f97ac2c {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Ensure instance console log exists: /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:01 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Successfully created port: 9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:39:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Successfully updated port: 9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:39:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "refresh_cache-9da338fc-f979-4df6-b83e-8cb78f97ac2c" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:39:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquired lock "refresh_cache-9da338fc-f979-4df6-b83e-8cb78f97ac2c" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:39:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:39:02 user nova-compute[71507]: DEBUG nova.network.neutron [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:39:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received event network-changed-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:02 user nova-compute[71507]: DEBUG nova.compute.manager [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Refreshing instance network info cache due to event network-changed-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:39:02 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] Acquiring lock "refresh_cache-9da338fc-f979-4df6-b83e-8cb78f97ac2c" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.network.neutron [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Updating instance_info_cache with network_info: [{"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Releasing lock "refresh_cache-9da338fc-f979-4df6-b83e-8cb78f97ac2c" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Instance network_info: |[{"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] Acquired lock "refresh_cache-9da338fc-f979-4df6-b83e-8cb78f97ac2c" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.network.neutron [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Refreshing network info cache for port 9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Start _get_guest_xml network_info=[{"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:39:03 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:39:03 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T15:03:41Z,direct_url=<?>,disk_format='qcow2',id=90e5cdd0-62b7-441b-9971-cfa8e8a0478d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='bd1bb5aff7c24a6e9eb594ef3258d98d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T15:03:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:39:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-198393882',display_name='tempest-VolumesSnapshotTestJSON-instance-198393882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-198393882',id=44,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0a40f5a9b5e4f3fb8467b6ea304bbe5',ramdisk_id='',reservation_id='r-pr0bo851',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-392588653',owner_user_name='tempest-VolumesSnapshotTestJSON-392588653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:39:01Z,user_data=None,user_id='300cbdea17c74a418f50e2d581691ad3',uuid=9da338fc-f979-4df6-b83e-8cb78f97ac2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converting VIF {"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc79b2b-d5') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.objects.instance [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'pci_devices' on Instance uuid 9da338fc-f979-4df6-b83e-8cb78f97ac2c {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:39:03 user nova-compute[71507]:   <uuid>9da338fc-f979-4df6-b83e-8cb78f97ac2c</uuid>
Apr 13 15:39:03 user nova-compute[71507]:   <name>instance-0000002c</name>
Apr 13 15:39:03 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:39:03 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:39:03 user nova-compute[71507]:   <metadata>
Apr 13 15:39:03 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:39:03 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:39:03 user nova-compute[71507]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-198393882</nova:name>
Apr 13 15:39:03 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:39:03</nova:creationTime>
Apr 13 15:39:03 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:39:03 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:39:03 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:39:03 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:39:03 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:39:03 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:39:03 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:39:03 user nova-compute[71507]:       <nova:owner>
Apr 13 15:39:03 user nova-compute[71507]:         <nova:user uuid="300cbdea17c74a418f50e2d581691ad3">tempest-VolumesSnapshotTestJSON-392588653-project-member</nova:user>
Apr 13 15:39:03 user nova-compute[71507]:         <nova:project uuid="a0a40f5a9b5e4f3fb8467b6ea304bbe5">tempest-VolumesSnapshotTestJSON-392588653</nova:project>
Apr 13 15:39:03 user nova-compute[71507]:       </nova:owner>
Apr 13 15:39:03 user nova-compute[71507]:       <nova:root type="image" uuid="90e5cdd0-62b7-441b-9971-cfa8e8a0478d"/>
Apr 13 15:39:03 user nova-compute[71507]:       <nova:ports>
Apr 13 15:39:03 user nova-compute[71507]:         <nova:port uuid="9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d">
Apr 13 15:39:03 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 15:39:03 user nova-compute[71507]:         </nova:port>
Apr 13 15:39:03 user nova-compute[71507]:       </nova:ports>
Apr 13 15:39:03 user nova-compute[71507]:     </nova:instance>
Apr 13 15:39:03 user nova-compute[71507]:   </metadata>
Apr 13 15:39:03 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:39:03 user nova-compute[71507]:     <system>
Apr 13 15:39:03 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:39:03 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:39:03 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:39:03 user nova-compute[71507]:       <entry name="serial">9da338fc-f979-4df6-b83e-8cb78f97ac2c</entry>
Apr 13 15:39:03 user nova-compute[71507]:       <entry name="uuid">9da338fc-f979-4df6-b83e-8cb78f97ac2c</entry>
Apr 13 15:39:03 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:39:03 user nova-compute[71507]:     </system>
Apr 13 15:39:03 user nova-compute[71507]:   </sysinfo>
Apr 13 15:39:03 user nova-compute[71507]:   <os>
Apr 13 15:39:03 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:39:03 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:39:03 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:39:03 user nova-compute[71507]:   </os>
Apr 13 15:39:03 user nova-compute[71507]:   <features>
Apr 13 15:39:03 user nova-compute[71507]:     <acpi/>
Apr 13 15:39:03 user nova-compute[71507]:     <apic/>
Apr 13 15:39:03 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:39:03 user nova-compute[71507]:   </features>
Apr 13 15:39:03 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:39:03 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:39:03 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:39:03 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:39:03 user nova-compute[71507]:   </clock>
Apr 13 15:39:03 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:39:03 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:39:03 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:39:03 user nova-compute[71507]:   </cpu>
Apr 13 15:39:03 user nova-compute[71507]:   <devices>
Apr 13 15:39:03 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:39:03 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:39:03 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk"/>
Apr 13 15:39:03 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:39:03 user nova-compute[71507]:     </disk>
Apr 13 15:39:03 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:39:03 user nova-compute[71507]:       <mac address="fa:16:3e:6c:2d:c1"/>
Apr 13 15:39:03 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:39:03 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:39:03 user nova-compute[71507]:       <target dev="tap9bc79b2b-d5"/>
Apr 13 15:39:03 user nova-compute[71507]:     </interface>
Apr 13 15:39:03 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:39:03 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/console.log" append="off"/>
Apr 13 15:39:03 user nova-compute[71507]:     </serial>
Apr 13 15:39:03 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:39:03 user nova-compute[71507]:     <video>
Apr 13 15:39:03 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:39:03 user nova-compute[71507]:     </video>
Apr 13 15:39:03 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:39:03 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:39:03 user nova-compute[71507]:     </rng>
Apr 13 15:39:03 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:39:03 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:39:03 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:39:03 user nova-compute[71507]:     </memballoon>
Apr 13 15:39:03 user nova-compute[71507]:   </devices>
Apr 13 15:39:03 user nova-compute[71507]: </domain>
Apr 13 15:39:03 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:39:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-198393882',display_name='tempest-VolumesSnapshotTestJSON-instance-198393882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-198393882',id=44,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0a40f5a9b5e4f3fb8467b6ea304bbe5',ramdisk_id='',reservation_id='r-pr0bo851',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-392588653',owner_user_name='tempest-VolumesSnapshotTestJSON-392588653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:39:01Z,user_data=None,user_id='300cbdea17c74a418f50e2d581691ad3',uuid=9da338fc-f979-4df6-b83e-8cb78f97ac2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converting VIF {"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc79b2b-d5') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG os_vif [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc79b2b-d5') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bc79b2b-d5, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9bc79b2b-d5, col_values=(('external_ids', {'iface-id': '9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:2d:c1', 'vm-uuid': '9da338fc-f979-4df6-b83e-8cb78f97ac2c'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:03 user nova-compute[71507]: INFO os_vif [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc79b2b-d5')
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No VIF found with MAC fa:16:3e:6c:2d:c1, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.network.neutron [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Updated VIF entry in instance network info cache for port 9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG nova.network.neutron [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Updating instance_info_cache with network_info: [{"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:39:03 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-88f4ab1b-243b-4ed0-bcab-24c80a287c95 req-b3268204-f32f-4923-9c61-7c3e0f906680 service nova] Releasing lock "refresh_cache-9da338fc-f979-4df6-b83e-8cb78f97ac2c" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:39:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:04 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received event network-vif-plugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:04 user nova-compute[71507]: DEBUG nova.compute.manager [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] No waiting events found dispatching network-vif-plugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:39:04 user nova-compute[71507]: WARNING nova.compute.manager [req-df31308b-c873-492b-9ffe-4317bdd9797a req-226d1b04-952e-40b1-803c-9cb285bcca63 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received unexpected event network-vif-plugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance with vm_state building and task_state spawning.
Apr 13 15:39:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400346.5913875, 9da338fc-f979-4df6-b83e-8cb78f97ac2c => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:39:06 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] VM Resumed (Lifecycle Event)
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:39:06 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Instance spawned successfully.
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:06 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400346.5929058, 9da338fc-f979-4df6-b83e-8cb78f97ac2c => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:39:06 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] VM Started (Lifecycle Event)
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:39:06 user nova-compute[71507]: INFO nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Took 5.47 seconds to spawn the instance on the hypervisor.
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:39:06 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:39:06 user nova-compute[71507]: INFO nova.compute.manager [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Took 6.00 seconds to build instance.
Apr 13 15:39:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-16f7d484-1ff7-467c-98f7-e79194b5b1e9 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.101s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received event network-vif-plugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:06 user nova-compute[71507]: DEBUG nova.compute.manager [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] No waiting events found dispatching network-vif-plugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:39:06 user nova-compute[71507]: WARNING nova.compute.manager [req-a67f36e1-1021-4761-867a-889441dbb9bf req-a4969535-fdae-4be3-9724-f878c622ef55 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received unexpected event network-vif-plugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance with vm_state active and task_state None.
Apr 13 15:39:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received event network-changed-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Refreshing instance network info cache due to event network-changed-bee671f2-48c8-41d0-945c-3c8b796aa286. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:39:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] Acquiring lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:39:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] Acquired lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:39:12 user nova-compute[71507]: DEBUG nova.network.neutron [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Refreshing network info cache for port bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:39:13 user nova-compute[71507]: DEBUG nova.network.neutron [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updated VIF entry in instance network info cache for port bee671f2-48c8-41d0-945c-3c8b796aa286. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:39:13 user nova-compute[71507]: DEBUG nova.network.neutron [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating instance_info_cache with network_info: [{"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:39:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-36b942a1-2aa6-4043-ad89-3163349ba33f req-1b90e38a-bf7f-4ab5-a722-e7a1ec97bc65 service nova] Releasing lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:39:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:13 user nova-compute[71507]: DEBUG nova.objects.instance [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:14 user nova-compute[71507]: INFO nova.compute.manager [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attaching volume 23c7fbd7-2e84-41c8-b932-13e78019b008 to /dev/vdb
Apr 13 15:39:14 user nova-compute[71507]: DEBUG os_brick.utils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa3e23d-9856-46ef-b06a-3cee0c5526d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef3ff04-fdf6-4245-bb94-59b286c8e2ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d017999-c81a-40c6-b6fe-67e28dc8443d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e266dc-c3a9-4a85-a95b-b8459142d578]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:39:14 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:39:14 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cb0a1f-0ecb-4b43-86dc-a09d33f6e555]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG os_brick.utils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:39:14 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating existing volume attachment record: fd401b79-5f88-4d45-b351-3b9d9204a364 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onlNaVHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:39:18 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:39:18 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:39:18 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e72f25-d63b-496a-9bc4-3ca3ea0495fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:39:18 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8e92d1-9e15-42f5-9b71-5227862ac6ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008] added
Apr 13 15:39:18 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[33af0e6a-5ada-4ac8-aa11-c1836694fa2b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[869bf1c5-2bed-47a3-81c7-880b57e57171]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v onlNaVHZ {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v onlNaVHZ" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19ff7d7-7724-4118-a6f5-fd46dbcab6ae]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'onlNaVHZ'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ff108e-e5f8-45b9-978a-e5974836c961]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f0ef1f-f877-485a-98a5-32e1b6ac80da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:39:18 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:39:18 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:39:18 user nova-compute[71507]:  {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:39:18 user nova-compute[71507]: WARNING os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 15:39:18 user nova-compute[71507]: 
Apr 13 15:39:18 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc9fc15-f640-425c-a10a-83ebf60be11e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008, portal: 172.16.0.220,3260]
Apr 13 15:39:19 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008, portal: 172.16.0.220,3260] successful.
Apr 13 15:39:19 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[591cd3fd-054e-4147-a9ed-d64b06c14747]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b280cf16-c865-40d1-8dd7-760194ae2cb6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)
Apr 13 15:39:19 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)
Apr 13 15:39:19 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bb00fc-4a76-4238-8e3d-ef308f106665]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:39:19 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onlNaVHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:39:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:39:20 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23738393538343161', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:39:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738393538343161', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:39:20 user nova-compute[71507]: DEBUG nova.objects.instance [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:39:20 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:39:20 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:39:20 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:39:20 user nova-compute[71507]:   <serial>23c7fbd7-2e84-41c8-b932-13e78019b008</serial>
Apr 13 15:39:20 user nova-compute[71507]: </disk>
Apr 13 15:39:20 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:39:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:39:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:39:20 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No VIF found with MAC fa:16:3e:db:92:0d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:39:20 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-315d93ed-9fbe-486f-b07c-2063a15e998d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.669s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:22 user nova-compute[71507]: INFO nova.compute.manager [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Unshelving
Apr 13 15:39:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:22 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:22 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'pci_requests' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:22 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'numa_topology' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:22 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:39:22 user nova-compute[71507]: INFO nova.compute.claims [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Claim successful on node user
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "4a17bf49-ffae-4178-b484-6c45bd80fb12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:23 user nova-compute[71507]: INFO nova.network.neutron [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating port 1cb2ae52-e4fa-4627-b3f3-301af5732358 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:39:23 user nova-compute[71507]: INFO nova.compute.claims [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Claim successful on node user
Apr 13 15:39:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:39:23 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:39:23 user nova-compute[71507]: INFO nova.virt.block_device [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Booting with volume 0a9e3ad7-579a-414a-8143-d36ef6b41bf8 at /dev/vda
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.policy [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG os_brick.utils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e66b0aa-ab23-4b44-9588-8eaf184ac63c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2253509c-56ea-4fc5-a9e7-d8b1761a4ad5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ee81c7-aa0e-4a05-a171-9166b4115b84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b103f2af-cd8f-4129-a4e1-4d7a09a2c9e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:39:23 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc21c25-8b89-4fb2-8269-06b2741748df]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG os_brick.utils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Updating existing volume attachment record: b7696551-65bf-4b37-abdf-27d417e07619 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquired lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:39:23 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-changed-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG nova.compute.manager [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Refreshing instance network info cache due to event network-changed-1cb2ae52-e4fa-4627-b3f3-301af5732358. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] Acquiring lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Successfully created port: 1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG nova.network.neutron [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Releasing lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:39:24 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Creating image(s)
Apr 13 15:39:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'trusted_certs' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] Acquired lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG nova.network.neutron [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Refreshing network info cache for port 1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "d46823831e62ebe8fd67894abc9ebb89d1758c58" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "d46823831e62ebe8fd67894abc9ebb89d1758c58" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58.part --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Successfully updated port: 1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58.part --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG nova.virt.images [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] 444c3871-8575-4487-b66c-a8f21ab0541d was qcow2, converting to raw {{(pid=71507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG nova.privsep.utils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58.part /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58.converted {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "refresh_cache-4a17bf49-ffae-4178-b484-6c45bd80fb12" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquired lock "refresh_cache-4a17bf49-ffae-4178-b484-6c45bd80fb12" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received event network-changed-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG nova.compute.manager [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Refreshing instance network info cache due to event network-changed-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] Acquiring lock "refresh_cache-4a17bf49-ffae-4178-b484-6c45bd80fb12" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:39:25 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG nova.network.neutron [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Updating instance_info_cache with network_info: [{"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Releasing lock "refresh_cache-4a17bf49-ffae-4178-b484-6c45bd80fb12" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Instance network_info: |[{"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58.part /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58.converted" returned: 0 in 0.542s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] Acquired lock "refresh_cache-4a17bf49-ffae-4178-b484-6c45bd80fb12" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Refreshing network info cache for port 1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58.converted --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58.converted --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "d46823831e62ebe8fd67894abc9ebb89d1758c58" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.671s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updated VIF entry in instance network info cache for port 1cb2ae52-e4fa-4627-b3f3-301af5732358. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-17d14721-7ebd-4a79-8f3d-b045e2064da2 req-71e445ac-6b49-4fbe-975d-bfa57a0e0ab1 service nova] Releasing lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58 --force-share --output=json" returned: 0 in 0.139s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "d46823831e62ebe8fd67894abc9ebb89d1758c58" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "d46823831e62ebe8fd67894abc9ebb89d1758c58" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58 --force-share --output=json" returned: 0 in 0.158s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58,backing_fmt=raw /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk 1073741824 {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58,backing_fmt=raw /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk 1073741824" returned: 0 in 0.054s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "d46823831e62ebe8fd67894abc9ebb89d1758c58" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Updated VIF entry in instance network info cache for port 1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG nova.network.neutron [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Updating instance_info_cache with network_info: [{"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-753e76a1-b0f3-4fd7-8454-2358522a72be req-1eb93a20-16ec-4cca-bced-79270b39ab57 service nova] Releasing lock "refresh_cache-4a17bf49-ffae-4178-b484-6c45bd80fb12" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58 --force-share --output=json" returned: 0 in 0.140s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'migration_context' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:26 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Rebasing disk image.
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:26 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 -F raw /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918 -F raw /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk" returned: 0 in 2.061s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Created local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Ensure instance console log exists: /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Start _get_guest_xml network_info=[{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0330f1680bdd06cd63a7feb0f5748c0b',container_format='bare',created_at=2023-04-13T15:37:29Z,direct_url=<?>,disk_format='qcow2',id=444c3871-8575-4487-b66c-a8f21ab0541d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1461623425-shelved',owner='51df4613a6664a0fab857a9a83b6df62',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T15:37:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '90e5cdd0-62b7-441b-9971-cfa8e8a0478d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:39:29 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:39:29 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0330f1680bdd06cd63a7feb0f5748c0b',container_format='bare',created_at=2023-04-13T15:37:29Z,direct_url=<?>,disk_format='qcow2',id=444c3871-8575-4487-b66c-a8f21ab0541d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1461623425-shelved',owner='51df4613a6664a0fab857a9a83b6df62',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T15:37:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'vcpu_model' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1461623425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1461623425',id=40,image_ref='444c3871-8575-4487-b66c-a8f21ab0541d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-249143367',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-iqgyjdxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member',shelved_at='2023-04-13T15:37:34.118045',shelved_host='user',shelved_image_id='444c3871-8575-4487-b66c-a8f21ab0541d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=32b179d3-712f-47bc-94ad-387c8ca77380,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'pci_devices' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:39:29 user nova-compute[71507]:   <uuid>32b179d3-712f-47bc-94ad-387c8ca77380</uuid>
Apr 13 15:39:29 user nova-compute[71507]:   <name>instance-00000028</name>
Apr 13 15:39:29 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:39:29 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:39:29 user nova-compute[71507]:   <metadata>
Apr 13 15:39:29 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:39:29 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:39:29 user nova-compute[71507]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1461623425</nova:name>
Apr 13 15:39:29 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:39:29</nova:creationTime>
Apr 13 15:39:29 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:39:29 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:39:29 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:39:29 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:39:29 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:39:29 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:39:29 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:39:29 user nova-compute[71507]:       <nova:owner>
Apr 13 15:39:29 user nova-compute[71507]:         <nova:user uuid="a0bc1b61d8dc44aa8460fe2cd510c0a4">tempest-AttachVolumeShelveTestJSON-1608248430-project-member</nova:user>
Apr 13 15:39:29 user nova-compute[71507]:         <nova:project uuid="51df4613a6664a0fab857a9a83b6df62">tempest-AttachVolumeShelveTestJSON-1608248430</nova:project>
Apr 13 15:39:29 user nova-compute[71507]:       </nova:owner>
Apr 13 15:39:29 user nova-compute[71507]:       <nova:root type="image" uuid="444c3871-8575-4487-b66c-a8f21ab0541d"/>
Apr 13 15:39:29 user nova-compute[71507]:       <nova:ports>
Apr 13 15:39:29 user nova-compute[71507]:         <nova:port uuid="1cb2ae52-e4fa-4627-b3f3-301af5732358">
Apr 13 15:39:29 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 15:39:29 user nova-compute[71507]:         </nova:port>
Apr 13 15:39:29 user nova-compute[71507]:       </nova:ports>
Apr 13 15:39:29 user nova-compute[71507]:     </nova:instance>
Apr 13 15:39:29 user nova-compute[71507]:   </metadata>
Apr 13 15:39:29 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:39:29 user nova-compute[71507]:     <system>
Apr 13 15:39:29 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:39:29 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:39:29 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:39:29 user nova-compute[71507]:       <entry name="serial">32b179d3-712f-47bc-94ad-387c8ca77380</entry>
Apr 13 15:39:29 user nova-compute[71507]:       <entry name="uuid">32b179d3-712f-47bc-94ad-387c8ca77380</entry>
Apr 13 15:39:29 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:39:29 user nova-compute[71507]:     </system>
Apr 13 15:39:29 user nova-compute[71507]:   </sysinfo>
Apr 13 15:39:29 user nova-compute[71507]:   <os>
Apr 13 15:39:29 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:39:29 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:39:29 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:39:29 user nova-compute[71507]:   </os>
Apr 13 15:39:29 user nova-compute[71507]:   <features>
Apr 13 15:39:29 user nova-compute[71507]:     <acpi/>
Apr 13 15:39:29 user nova-compute[71507]:     <apic/>
Apr 13 15:39:29 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:39:29 user nova-compute[71507]:   </features>
Apr 13 15:39:29 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:39:29 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:39:29 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:39:29 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:39:29 user nova-compute[71507]:   </clock>
Apr 13 15:39:29 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:39:29 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:39:29 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:39:29 user nova-compute[71507]:   </cpu>
Apr 13 15:39:29 user nova-compute[71507]:   <devices>
Apr 13 15:39:29 user nova-compute[71507]:     <disk type="file" device="disk">
Apr 13 15:39:29 user nova-compute[71507]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 15:39:29 user nova-compute[71507]:       <source file="/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk"/>
Apr 13 15:39:29 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:39:29 user nova-compute[71507]:     </disk>
Apr 13 15:39:29 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:39:29 user nova-compute[71507]:       <mac address="fa:16:3e:f5:18:a8"/>
Apr 13 15:39:29 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:39:29 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:39:29 user nova-compute[71507]:       <target dev="tap1cb2ae52-e4"/>
Apr 13 15:39:29 user nova-compute[71507]:     </interface>
Apr 13 15:39:29 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:39:29 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/console.log" append="off"/>
Apr 13 15:39:29 user nova-compute[71507]:     </serial>
Apr 13 15:39:29 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:39:29 user nova-compute[71507]:     <video>
Apr 13 15:39:29 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:39:29 user nova-compute[71507]:     </video>
Apr 13 15:39:29 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:39:29 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:39:29 user nova-compute[71507]:     </rng>
Apr 13 15:39:29 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:39:29 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:39:29 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:39:29 user nova-compute[71507]:     </memballoon>
Apr 13 15:39:29 user nova-compute[71507]:   </devices>
Apr 13 15:39:29 user nova-compute[71507]: </domain>
Apr 13 15:39:29 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1461623425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1461623425',id=40,image_ref='444c3871-8575-4487-b66c-a8f21ab0541d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-249143367',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-iqgyjdxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member',shelved_at='2023-04-13T15:37:34.118045',shelved_host='user',shelved_image_id='444c3871-8575-4487-b66c-a8f21ab0541d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=32b179d3-712f-47bc-94ad-387c8ca77380,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG os_vif [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cb2ae52-e4, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1cb2ae52-e4, col_values=(('external_ids', {'iface-id': '1cb2ae52-e4fa-4627-b3f3-301af5732358', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:18:a8', 'vm-uuid': '32b179d3-712f-47bc-94ad-387c8ca77380'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:29 user nova-compute[71507]: INFO os_vif [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4')
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:39:29 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] No VIF found with MAC fa:16:3e:f5:18:a8, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:39:30 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Creating image(s)
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Ensure instance console log exists: /opt/stack/data/nova/instances/4a17bf49-ffae-4178-b484-6c45bd80fb12/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Start _get_guest_xml network_info=[{"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtFEQnMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a17bf49-ffae-4178-b484-6c45bd80fb12', 'attached_at': '', 'detached_at': '', 'volume_id': '0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'serial': '0a9e3ad7-579a-414a-8143-d36ef6b41bf8'}, 'attachment_id': 'b7696551-65bf-4b37-abdf-27d417e07619', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:39:30 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:39:30 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtFEQnMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:39:30 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:39:30 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:39:30 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[028d3ccf-a3a2-4587-82f4-6dc2ffb93b38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:39:30 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34e1f29-bbcd-4087-86fc-7810082d1a7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8] added
Apr 13 15:39:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2edef0a-9cf9-47de-bf7b-d4ac33926371]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[165c55ac-ba52-417e-992c-3d9d8627470b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtFEQnMA {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtFEQnMA" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d67f08a-c2ab-4ca0-885a-6d44d8614d36]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtFEQnMA'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89133836-1e2e-4482-be88-88af54b155fa]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaf2002-90a6-47e2-8ded-2655ebe594a7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)
Apr 13 15:39:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)
Apr 13 15:39:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0998f9-824d-431e-893e-a1a65475cfa0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260]
Apr 13 15:39:30 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260] successful.
Apr 13 15:39:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[989e3f36-5946-4f12-9e09-62d9c76f464e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[04173cac-2faf-4416-b686-04c39fe91d11]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)
Apr 13 15:39:30 user nova-compute[71507]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:39:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)
Apr 13 15:39:30 user nova-compute[71507]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:39:30 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4a9e0c-2502-4bb5-9072-efb2c6d6467c]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:30 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.compute.manager [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] No waiting events found dispatching network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:39:31 user nova-compute[71507]: WARNING nova.compute.manager [req-524686bc-7ddb-4a07-9b38-adfe1c6e3864 req-9b12d810-b944-4c90-8530-eb4ccebcac95 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received unexpected event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtFEQnMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23537363631666363', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537363631666363', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1423782443',display_name='tempest-TestVolumeBootPattern-server-1423782443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1423782443',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA==',key_name='tempest-TestVolumeBootPattern-534201410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-205bagyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:39:24Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=4a17bf49-ffae-4178-b484-6c45bd80fb12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:69:44,bridge_name='br-int',has_traffic_filtering=True,id=1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dee69e3-2a') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.objects.instance [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a17bf49-ffae-4178-b484-6c45bd80fb12 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:39:31 user nova-compute[71507]:   <uuid>4a17bf49-ffae-4178-b484-6c45bd80fb12</uuid>
Apr 13 15:39:31 user nova-compute[71507]:   <name>instance-0000002d</name>
Apr 13 15:39:31 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:39:31 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:39:31 user nova-compute[71507]:   <metadata>
Apr 13 15:39:31 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:39:31 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:39:31 user nova-compute[71507]:       <nova:name>tempest-TestVolumeBootPattern-server-1423782443</nova:name>
Apr 13 15:39:31 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:39:30</nova:creationTime>
Apr 13 15:39:31 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:39:31 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:39:31 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:39:31 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:39:31 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:39:31 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:39:31 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:39:31 user nova-compute[71507]:       <nova:owner>
Apr 13 15:39:31 user nova-compute[71507]:         <nova:user uuid="0307fb8d127a41079e34355904352231">tempest-TestVolumeBootPattern-374778702-project-member</nova:user>
Apr 13 15:39:31 user nova-compute[71507]:         <nova:project uuid="d5d7f771264c4cd2bc595a2c525082d0">tempest-TestVolumeBootPattern-374778702</nova:project>
Apr 13 15:39:31 user nova-compute[71507]:       </nova:owner>
Apr 13 15:39:31 user nova-compute[71507]:       <nova:ports>
Apr 13 15:39:31 user nova-compute[71507]:         <nova:port uuid="1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1">
Apr 13 15:39:31 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 15:39:31 user nova-compute[71507]:         </nova:port>
Apr 13 15:39:31 user nova-compute[71507]:       </nova:ports>
Apr 13 15:39:31 user nova-compute[71507]:     </nova:instance>
Apr 13 15:39:31 user nova-compute[71507]:   </metadata>
Apr 13 15:39:31 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:39:31 user nova-compute[71507]:     <system>
Apr 13 15:39:31 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:39:31 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:39:31 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:39:31 user nova-compute[71507]:       <entry name="serial">4a17bf49-ffae-4178-b484-6c45bd80fb12</entry>
Apr 13 15:39:31 user nova-compute[71507]:       <entry name="uuid">4a17bf49-ffae-4178-b484-6c45bd80fb12</entry>
Apr 13 15:39:31 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:39:31 user nova-compute[71507]:     </system>
Apr 13 15:39:31 user nova-compute[71507]:   </sysinfo>
Apr 13 15:39:31 user nova-compute[71507]:   <os>
Apr 13 15:39:31 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:39:31 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:39:31 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:39:31 user nova-compute[71507]:   </os>
Apr 13 15:39:31 user nova-compute[71507]:   <features>
Apr 13 15:39:31 user nova-compute[71507]:     <acpi/>
Apr 13 15:39:31 user nova-compute[71507]:     <apic/>
Apr 13 15:39:31 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:39:31 user nova-compute[71507]:   </features>
Apr 13 15:39:31 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:39:31 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:39:31 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:39:31 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:39:31 user nova-compute[71507]:   </clock>
Apr 13 15:39:31 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:39:31 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:39:31 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:39:31 user nova-compute[71507]:   </cpu>
Apr 13 15:39:31 user nova-compute[71507]:   <devices>
Apr 13 15:39:31 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:39:31 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:39:31 user nova-compute[71507]:       <source dev="/dev/sdc"/>
Apr 13 15:39:31 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:39:31 user nova-compute[71507]:       <serial>0a9e3ad7-579a-414a-8143-d36ef6b41bf8</serial>
Apr 13 15:39:31 user nova-compute[71507]:     </disk>
Apr 13 15:39:31 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:39:31 user nova-compute[71507]:       <mac address="fa:16:3e:c5:69:44"/>
Apr 13 15:39:31 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:39:31 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:39:31 user nova-compute[71507]:       <target dev="tap1dee69e3-2a"/>
Apr 13 15:39:31 user nova-compute[71507]:     </interface>
Apr 13 15:39:31 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:39:31 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/4a17bf49-ffae-4178-b484-6c45bd80fb12/console.log" append="off"/>
Apr 13 15:39:31 user nova-compute[71507]:     </serial>
Apr 13 15:39:31 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:39:31 user nova-compute[71507]:     <video>
Apr 13 15:39:31 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:39:31 user nova-compute[71507]:     </video>
Apr 13 15:39:31 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:39:31 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:39:31 user nova-compute[71507]:     </rng>
Apr 13 15:39:31 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:39:31 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:39:31 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:39:31 user nova-compute[71507]:     </memballoon>
Apr 13 15:39:31 user nova-compute[71507]:   </devices>
Apr 13 15:39:31 user nova-compute[71507]: </domain>
Apr 13 15:39:31 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1423782443',display_name='tempest-TestVolumeBootPattern-server-1423782443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1423782443',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA==',key_name='tempest-TestVolumeBootPattern-534201410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-205bagyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:39:24Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=4a17bf49-ffae-4178-b484-6c45bd80fb12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:69:44,bridge_name='br-int',has_traffic_filtering=True,id=1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dee69e3-2a') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG os_vif [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:69:44,bridge_name='br-int',has_traffic_filtering=True,id=1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dee69e3-2a') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dee69e3-2a, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1dee69e3-2a, col_values=(('external_ids', {'iface-id': '1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:69:44', 'vm-uuid': '4a17bf49-ffae-4178-b484-6c45bd80fb12'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:31 user nova-compute[71507]: INFO os_vif [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:69:44,bridge_name='br-int',has_traffic_filtering=True,id=1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dee69e3-2a')
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:39:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No VIF found with MAC fa:16:3e:c5:69:44, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] No waiting events found dispatching network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:39:33 user nova-compute[71507]: WARNING nova.compute.manager [req-580dc033-034b-4a78-a5d6-1bcf2e71d1a5 req-14ea7a54-44ea-4435-9e75-bf3d244f1c6f service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received unexpected event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400373.4575508, 32b179d3-712f-47bc-94ad-387c8ca77380 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:39:33 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] VM Resumed (Lifecycle Event)
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received event network-vif-plugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] Acquiring lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] No waiting events found dispatching network-vif-plugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:39:33 user nova-compute[71507]: WARNING nova.compute.manager [req-12d16540-78db-411a-84da-92306487c55d req-af97b1e9-60a7-4c52-bc8e-fc8d8a883db4 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received unexpected event network-vif-plugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance with vm_state building and task_state spawning.
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:39:33 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance spawned successfully.
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:33 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400373.4666858, 32b179d3-712f-47bc-94ad-387c8ca77380 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:39:33 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] VM Started (Lifecycle Event)
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:39:33 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:39:33 user nova-compute[71507]: DEBUG nova.compute.manager [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-d2865ae2-6b74-4de5-aac1-00c04606b4b2 tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.070s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:33 user nova-compute[71507]: INFO nova.compute.manager [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Detaching volume 23c7fbd7-2e84-41c8-b932-13e78019b008
Apr 13 15:39:34 user nova-compute[71507]: INFO nova.virt.block_device [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attempting to driver detach volume 23c7fbd7-2e84-41c8-b932-13e78019b008 from mountpoint /dev/vdb
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Attempting to detach device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:39:34 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:39:34 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:39:34 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:39:34 user nova-compute[71507]:   <serial>23c7fbd7-2e84-41c8-b932-13e78019b008</serial>
Apr 13 15:39:34 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:39:34 user nova-compute[71507]: </disk>
Apr 13 15:39:34 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:39:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully detached device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the persistent domain config.
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:39:34 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:39:34 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:39:34 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:39:34 user nova-compute[71507]:   <serial>23c7fbd7-2e84-41c8-b932-13e78019b008</serial>
Apr 13 15:39:34 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:39:34 user nova-compute[71507]: </disk>
Apr 13 15:39:34 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681400374.5183399, dccdbfbe-1261-490e-b8bf-b06e46d42f37 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:39:34 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully detached device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the live domain config.
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onlNaVHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:39:34 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d987735b-3353-4743-8a10-d2858a92b723]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:39:34 user nova-compute[71507]: No targets found.
Apr 13 15:39:34 user nova-compute[71507]: iSNS:
Apr 13 15:39:34 user nova-compute[71507]: No targets found.
Apr 13 15:39:34 user nova-compute[71507]: STATIC:
Apr 13 15:39:34 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8
Apr 13 15:39:34 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:39:34 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:39:34 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008
Apr 13 15:39:34 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:39:34 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:39:34 user nova-compute[71507]: FIRMWARE:
Apr 13 15:39:34 user nova-compute[71507]: No targets found.
Apr 13 15:39:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:39:34 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:39:34 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Skipping network cache update for instance because it is Building. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d41f7dc-bb4c-419d-b18b-a26df22fd456]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[653a7abb-bcef-4bc5-ad57-bc3f214b6fc5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)
Apr 13 15:39:34 user nova-compute[71507]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:39:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 (non-flash)
Apr 13 15:39:34 user nova-compute[71507]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:39:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c245360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[666691fe-55c5-485d-9220-d120fac3183e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796771e-ff89-47ca-a2e3-b3f53cc548ce]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf675eaa-fdd4-4c49-8569-41f4f7f8f1e3]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8164a-b5ac-4b7b-a652-59efe2120a5b]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9508e0-ec50-47f3-a736-7c44d1817280]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a65096-5769-4def-8bc4-ab9182a863ae]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008, portal: 172.16.0.220,3260]
Apr 13 15:39:34 user nova-compute[71507]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008, portal: 172.16.0.220,3260] successful.
Apr 13 15:39:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c7fbd7-2e84-41c8-b932-13e78019b008 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d759b9-f2c4-4ce3-ab6b-b452741083b2]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== disconnect_volume: return (331ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:39:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [{"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-32b179d3-712f-47bc-94ad-387c8ca77380" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received event network-vif-plugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] Acquiring lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.compute.manager [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] No waiting events found dispatching network-vif-plugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:39:35 user nova-compute[71507]: WARNING nova.compute.manager [req-e70c3f95-11d9-48af-8cb8-cb9c51377ce2 req-2e29f085-4c7c-432c-804f-bc1c6276136e service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received unexpected event network-vif-plugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance with vm_state building and task_state spawning.
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400375.5933042, 4a17bf49-ffae-4178-b484-6c45bd80fb12 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:39:35 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] VM Resumed (Lifecycle Event)
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:39:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Instance spawned successfully.
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:39:35 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400375.6034718, 4a17bf49-ffae-4178-b484-6c45bd80fb12 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:39:35 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] VM Started (Lifecycle Event)
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:39:35 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.objects.instance [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:39:35 user nova-compute[71507]: INFO nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Took 5.47 seconds to spawn the instance on the hypervisor.
Apr 13 15:39:35 user nova-compute[71507]: DEBUG nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:39:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-955ff295-06f9-4b90-bb99-6ed81b8be01f tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.847s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:35 user nova-compute[71507]: INFO nova.compute.manager [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Took 12.59 seconds to build instance.
Apr 13 15:39:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-5b88c56b-1cf2-45cf-a59b-e983274261da tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.693s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:43 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:39:44 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:39:44 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:39:44 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=26.02832794189453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:39:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 32b179d3-712f-47bc-94ad-387c8ca77380 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:39:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:39:46 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:39:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:48 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:39:48 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:39:49 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:39:50 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:39:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:39:54 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:39:54 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:39:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:39:58 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:40:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:40:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:40:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:40:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:40:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:40:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:40:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:40:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:40:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:40:26 user nova-compute[71507]: DEBUG nova.objects.instance [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:40:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:26 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:40:27 user nova-compute[71507]: INFO nova.compute.manager [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attaching volume c7a6c16d-f2af-483b-953d-4d178cc7eddb to /dev/vdb
Apr 13 15:40:27 user nova-compute[71507]: DEBUG os_brick.utils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f5ec66-9a5d-424a-b66a-d8e6c1418cc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77fca5f-1a69-407e-9815-cca98b388374]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd08c70-d0e8-48cd-8ab1-b0f697e5be4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[42beb7ee-ea68-4c7a-aa76-7c93e4aa87fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:40:27 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:40:27 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19f647c-2dc7-4e20-9da3-216ee0a6105d]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG os_brick.utils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:40:27 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating existing volume attachment record: 6e2ac278-617d-44fb-8de8-6e1fdc3c50e4 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:40:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlJUXOWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:40:31 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:40:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:40:31 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:40:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:40:31 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[41571328-9799-47bc-86df-28aa9cbde537]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:40:31 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4f8dc-7e57-41c2-b559-72686243fc22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb] added
Apr 13 15:40:31 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[84841e5d-1c33-4b1a-82c9-7e7c15c4e9f8]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa01236e-69cb-404f-a0cf-9421e4ed20a5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:31 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlJUXOWy {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlJUXOWy" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f60bfa-5cc9-4ee5-9702-89378d669de9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZlJUXOWy'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10404ed7-8044-4ed2-bde5-2497bf24346e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfda1a2-48b5-48e5-a113-28526df69dde]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b78cba2-d29b-4663-a3ef-d20a06e1ded6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb, portal: 172.16.0.220,3260]
Apr 13 15:40:32 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb, portal: 172.16.0.220,3260] successful.
Apr 13 15:40:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[577ef0dd-8ae3-4c70-bd29-7648c36a2a29]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce637ce8-ee82-491d-a196-031ff304283c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:32 user nova-compute[71507]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb (non-flash)
Apr 13 15:40:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:32 user nova-compute[71507]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb (non-flash)
Apr 13 15:40:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[006f8fdd-bd98-45ba-8799-c7dee83249e1]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:40:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlJUXOWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:40:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:40:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23936393234356664', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:40:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936393234356664', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:40:33 user nova-compute[71507]: DEBUG nova.objects.instance [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:40:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:40:33 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:40:33 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:40:33 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:40:33 user nova-compute[71507]:   <serial>c7a6c16d-f2af-483b-953d-4d178cc7eddb</serial>
Apr 13 15:40:33 user nova-compute[71507]: </disk>
Apr 13 15:40:33 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:40:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:40:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:40:33 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No VIF found with MAC fa:16:3e:db:92:0d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:40:33 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-77d7c42d-a64e-41d6-9026-c9ad5ddd2f9d tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.728s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:40:35 user nova-compute[71507]: INFO nova.compute.manager [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Detaching volume c7a6c16d-f2af-483b-953d-4d178cc7eddb
Apr 13 15:40:35 user nova-compute[71507]: INFO nova.virt.block_device [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attempting to driver detach volume c7a6c16d-f2af-483b-953d-4d178cc7eddb from mountpoint /dev/vdb
Apr 13 15:40:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Attempting to detach device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:40:35 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:40:35 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:40:35 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:40:35 user nova-compute[71507]:   <serial>c7a6c16d-f2af-483b-953d-4d178cc7eddb</serial>
Apr 13 15:40:35 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:40:35 user nova-compute[71507]: </disk>
Apr 13 15:40:35 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:40:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully detached device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the persistent domain config.
Apr 13 15:40:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:40:35 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:40:35 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:40:35 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:40:35 user nova-compute[71507]:   <serial>c7a6c16d-f2af-483b-953d-4d178cc7eddb</serial>
Apr 13 15:40:35 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:40:35 user nova-compute[71507]: </disk>
Apr 13 15:40:35 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681400435.672548, dccdbfbe-1261-490e-b8bf-b06e46d42f37 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:40:35 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully detached device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the live domain config.
Apr 13 15:40:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlJUXOWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:40:35 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4223a57-3844-4a2a-80f8-bf7c0d6715c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:40:35 user nova-compute[71507]: No targets found.
Apr 13 15:40:35 user nova-compute[71507]: iSNS:
Apr 13 15:40:35 user nova-compute[71507]: No targets found.
Apr 13 15:40:35 user nova-compute[71507]: STATIC:
Apr 13 15:40:35 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb
Apr 13 15:40:35 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:40:35 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:40:35 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8
Apr 13 15:40:35 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:40:35 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:40:35 user nova-compute[71507]: FIRMWARE:
Apr 13 15:40:35 user nova-compute[71507]: No targets found.
Apr 13 15:40:35 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:40:35 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:40:35 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c075b4-e413-4495-84d8-dbc30ec3d2dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14c3552-3e1d-412e-8b67-3922346a3b8c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:35 user nova-compute[71507]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb (non-flash)
Apr 13 15:40:35 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:35 user nova-compute[71507]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb (non-flash)
Apr 13 15:40:35 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1422b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b299752-8d5e-4366-ab4d-677bfc16dc0a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72340b90-c6fa-431e-b0d5-168075ca54cc]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d5ff4-d066-4e67-a499-ab256570eae7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d6dc43-2fdc-4193-9b8b-7e7277b24662]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b92e782-c28c-4cd6-a256-cf417bf6fde0]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d02f91-a272-4006-af88-b2a79c767010]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb, portal: 172.16.0.220,3260]
Apr 13 15:40:35 user nova-compute[71507]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb, portal: 172.16.0.220,3260] successful.
Apr 13 15:40:35 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7a6c16d-f2af-483b-953d-4d178cc7eddb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb9d106-693d-4961-82af-c7aa13722b2e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== disconnect_volume: return (291ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:40:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-a779ab87-93b7-46d9-bf9f-d3aa8ee609f5 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:40:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:37 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating instance_info_cache with network_info: [{"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:40:37 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:40:37 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:40:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:46 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:40:46 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:40:46 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8372MB free_disk=26.026947021484375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:40:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 32b179d3-712f-47bc-94ad-387c8ca77380 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 4a17bf49-ffae-4178-b484-6c45bd80fb12 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:40:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:40:48 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:49 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:40:50 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:40:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:40:50 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'flavor' on Instance uuid 9da338fc-f979-4df6-b83e-8cb78f97ac2c {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:40:50 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Ignoring supplied device name: /dev/vdb
Apr 13 15:40:50 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:40:51 user nova-compute[71507]: INFO nova.compute.manager [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Attaching volume 99abd4d3-940d-4f80-9687-89f043d58d7d to /dev/vdb
Apr 13 15:40:51 user nova-compute[71507]: DEBUG os_brick.utils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffd1279-e955-4161-97c1-e460fdbe534b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e45dac-42b8-4fae-b4f1-afe375bc39d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22405f8-ab55-4dcd-953d-957f241891d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc83e39-972e-40c7-88f9-eb228a68ec2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:40:51 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e665eb-deef-4965-9ddd-6847c5e48e51]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG os_brick.utils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Updating existing volume attachment record: 4830cf84-d737-4d3d-8f52-899cd6502403 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:54 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloFJwhD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:40:55 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:40:55 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:40:55 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa70eb9-fc06-471b-8386-84fb12eaada9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:40:55 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f8135-3942-4334-a20b-f0ce80e4d6b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d] added
Apr 13 15:40:55 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d7e540-71f3-43b9-a523-1228afb52ca6]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c08497f-ed25-483e-ade5-07a600a7d8ad]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vloFJwhD {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vloFJwhD" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4d399c-1c43-4e49-9b3f-f780eb364d80]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vloFJwhD'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44dbe81-3600-4008-8832-e3733a0aa482]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:55 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f080c7dc-a78b-44b2-ba3f-1dfbbb028ca8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94367ee3-4af5-4f48-a475-515a7422a31c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d, portal: 172.16.0.220,3260]
Apr 13 15:40:56 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d, portal: 172.16.0.220,3260] successful.
Apr 13 15:40:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad3ba9d-aa19-4872-9528-c9adc5360db5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb97f2b-80c9-4ce0-8a57-e69d5ffbd008]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:56 user nova-compute[71507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d (non-flash)
Apr 13 15:40:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:40:56 user nova-compute[71507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d (non-flash)
Apr 13 15:40:56 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[69da2fc0-b664-4bfa-9bd4-cf9098db6f00]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloFJwhD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:40:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:40:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:40:57 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26335376438656237', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:40:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335376438656237', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:40:57 user nova-compute[71507]: DEBUG nova.objects.instance [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'flavor' on Instance uuid 9da338fc-f979-4df6-b83e-8cb78f97ac2c {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:40:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:40:57 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:40:57 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:40:57 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:40:57 user nova-compute[71507]:   <serial>99abd4d3-940d-4f80-9687-89f043d58d7d</serial>
Apr 13 15:40:57 user nova-compute[71507]: </disk>
Apr 13 15:40:57 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:40:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:40:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:40:57 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] No VIF found with MAC fa:16:3e:6c:2d:c1, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:40:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-e3291d27-406d-4561-b315-18aca4e1d288 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.635s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:41:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:41:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:41:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:41:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:09 user nova-compute[71507]: INFO nova.compute.manager [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Detaching volume 99abd4d3-940d-4f80-9687-89f043d58d7d
Apr 13 15:41:09 user nova-compute[71507]: INFO nova.virt.block_device [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Attempting to driver detach volume 99abd4d3-940d-4f80-9687-89f043d58d7d from mountpoint /dev/vdb
Apr 13 15:41:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Attempting to detach device vdb from instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:41:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:41:09 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:41:09 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:41:09 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:41:09 user nova-compute[71507]:   <serial>99abd4d3-940d-4f80-9687-89f043d58d7d</serial>
Apr 13 15:41:09 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:41:09 user nova-compute[71507]: </disk>
Apr 13 15:41:09 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:41:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Successfully detached device vdb from instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c from the persistent domain config.
Apr 13 15:41:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:41:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:41:09 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:41:09 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:41:09 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:41:09 user nova-compute[71507]:   <serial>99abd4d3-940d-4f80-9687-89f043d58d7d</serial>
Apr 13 15:41:09 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:41:09 user nova-compute[71507]: </disk>
Apr 13 15:41:09 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:41:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681400470.2797587, 9da338fc-f979-4df6-b83e-8cb78f97ac2c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:41:10 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Successfully detached device vdb from instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c from the live domain config.
Apr 13 15:41:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloFJwhD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:41:10 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6508d7b6-affa-4a43-a596-24057a6296e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:41:10 user nova-compute[71507]: No targets found.
Apr 13 15:41:10 user nova-compute[71507]: iSNS:
Apr 13 15:41:10 user nova-compute[71507]: No targets found.
Apr 13 15:41:10 user nova-compute[71507]: STATIC:
Apr 13 15:41:10 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d
Apr 13 15:41:10 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:41:10 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:41:10 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8
Apr 13 15:41:10 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:41:10 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:41:10 user nova-compute[71507]: FIRMWARE:
Apr 13 15:41:10 user nova-compute[71507]: No targets found.
Apr 13 15:41:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:41:10 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:41:10 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf1d91a-32a7-4180-9416-a262a0b2934d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[991baa23-73ac-474f-ae79-277d4528dfc0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:41:10 user nova-compute[71507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d (non-flash)
Apr 13 15:41:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:41:10 user nova-compute[71507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d (non-flash)
Apr 13 15:41:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faaf05753f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3a8794-feda-4a41-9faa-550dda1acbfa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40726e9-5d57-45a9-9271-ea673c0b3787]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[08961b1c-6c27-469d-8dbd-f66c7a3b8774]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[240aedc4-0835-4da8-b083-62f5a9cb4a72]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d85f21-4b5f-4ed5-9ac6-ff18d5ebfb11]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ff4d8d-5b75-4c6b-a2c4-9e8336751014]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d, portal: 172.16.0.220,3260]
Apr 13 15:41:10 user nova-compute[71507]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d, portal: 172.16.0.220,3260] successful.
Apr 13 15:41:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddd3eff-f201-4696-b7b3-1f3fc8a26c9b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] <== disconnect_volume: return (276ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:41:10 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'flavor' on Instance uuid 9da338fc-f979-4df6-b83e-8cb78f97ac2c {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-6ffa6c7c-57c0-4bfd-9850-bb5a02b1b387 tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.638s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.521s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:11 user nova-compute[71507]: INFO nova.compute.manager [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Terminating instance
Apr 13 15:41:11 user nova-compute[71507]: DEBUG nova.compute.manager [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received event network-vif-unplugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] No waiting events found dispatching network-vif-unplugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dbcf91f-dfc1-486d-8a19-3f726d613dbd req-2efca7c9-0fa7-4f8c-bc7b-53f680fec3da service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received event network-vif-unplugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Instance destroyed successfully.
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lazy-loading 'resources' on Instance uuid 9da338fc-f979-4df6-b83e-8cb78f97ac2c {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:39:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-198393882',display_name='tempest-VolumesSnapshotTestJSON-instance-198393882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-198393882',id=44,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:39:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0a40f5a9b5e4f3fb8467b6ea304bbe5',ramdisk_id='',reservation_id='r-pr0bo851',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-392588653',owner_user_name='tempest-VolumesSnapshotTestJSON-392588653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:39:07Z,user_data=None,user_id='300cbdea17c74a418f50e2d581691ad3',uuid=9da338fc-f979-4df6-b83e-8cb78f97ac2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converting VIF {"id": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "address": "fa:16:3e:6c:2d:c1", "network": {"id": "aaec5536-e991-4d34-ba54-00b2bd705bd9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1052391391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a0a40f5a9b5e4f3fb8467b6ea304bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bc79b2b-d5", "ovs_interfaceid": "9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc79b2b-d5') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_vif [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc79b2b-d5') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bc79b2b-d5, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:41:12 user nova-compute[71507]: INFO os_vif [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d,network=Network(aaec5536-e991-4d34-ba54-00b2bd705bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bc79b2b-d5')
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vloFJwhD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:41:12 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.compute.manager [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Terminating instance
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28f9218-d1ec-4bb1-ba4d-84a9bf611127]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:41:12 user nova-compute[71507]: No targets found.
Apr 13 15:41:12 user nova-compute[71507]: iSNS:
Apr 13 15:41:12 user nova-compute[71507]: No targets found.
Apr 13 15:41:12 user nova-compute[71507]: STATIC:
Apr 13 15:41:12 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8
Apr 13 15:41:12 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:41:12 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:41:12 user nova-compute[71507]: FIRMWARE:
Apr 13 15:41:12 user nova-compute[71507]: No targets found.
Apr 13 15:41:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:41:12 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:41:12 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99abd4d3-940d-4f80-9687-89f043d58d7d', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[99227b53-f45e-45d0-9ba8-73b3c44fb7b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dff7012-747b-40ac-90db-f039a09037f4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:41:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:41:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab289a3f40>, {}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Disconnecting from: [] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] <== disconnect_volume: return (71ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Deleting instance files /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c_del
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Deletion of /opt/stack/data/nova/instances/9da338fc-f979-4df6-b83e-8cb78f97ac2c_del complete
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.compute.manager [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Instance destroyed successfully.
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.objects.instance [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lazy-loading 'resources' on Instance uuid 32b179d3-712f-47bc-94ad-387c8ca77380 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T15:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1461623425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1461623425',id=40,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnB1XKsk+V/s+8svM9sTYLSdCjPIha2/SxAlkQCj7RRjLtDmMIHKWKDxVW7nV/0+Ei3Tt4l3pDA6FtDGaEcY6JOCIXBZUCsdZhUWv5y0PmkdIGRBBVocQPBaKYwc7DDpg==',key_name='tempest-keypair-249143367',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:39:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51df4613a6664a0fab857a9a83b6df62',ramdisk_id='',reservation_id='r-iqgyjdxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1608248430',owner_user_name='tempest-AttachVolumeShelveTestJSON-1608248430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bc1b61d8dc44aa8460fe2cd510c0a4',uuid=32b179d3-712f-47bc-94ad-387c8ca77380,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converting VIF {"id": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "address": "fa:16:3e:f5:18:a8", "network": {"id": "1d3a06de-0d0e-4486-b2f4-a1de430fcd8a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1737430895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51df4613a6664a0fab857a9a83b6df62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb2ae52-e4", "ovs_interfaceid": "1cb2ae52-e4fa-4627-b3f3-301af5732358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG os_vif [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cb2ae52-e4, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:12 user nova-compute[71507]: INFO os_vif [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:18:a8,bridge_name='br-int',has_traffic_filtering=True,id=1cb2ae52-e4fa-4627-b3f3-301af5732358,network=Network(1d3a06de-0d0e-4486-b2f4-a1de430fcd8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb2ae52-e4')
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Deleting instance files /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380_del
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Deletion of /opt/stack/data/nova/instances/32b179d3-712f-47bc-94ad-387c8ca77380_del complete
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.compute.manager [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 13 15:41:12 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Took 0.56 seconds to deallocate network for instance.
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received event network-vif-deleted-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.compute.manager [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Neutron deleted interface 9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d; detaching it from the instance and deleting it from the info cache
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.network.neutron [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:41:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-de71d93e-5095-4785-873f-5b936780176d req-dbf577e9-0e8e-460b-aa60-0bc9e5d56892 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Detach interface failed, port_id=9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d, reason: Instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c could not be found. {{(pid=71507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 15:41:12 user nova-compute[71507]: WARNING nova.volume.cinder [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Attachment 4830cf84-d737-4d3d-8f52-899cd6502403 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4830cf84-d737-4d3d-8f52-899cd6502403. (HTTP 404) (Request-ID: req-e7c668a0-00be-4195-9443-81ba50f8e28d)
Apr 13 15:41:12 user nova-compute[71507]: INFO nova.compute.manager [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Took 0.03 seconds to detach 1 volumes for instance.
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:13 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Deleted allocations for instance 9da338fc-f979-4df6-b83e-8cb78f97ac2c
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c3e6b6bc-e906-4d50-8c10-877accf60f9c tempest-VolumesSnapshotTestJSON-392588653 tempest-VolumesSnapshotTestJSON-392588653-project-member] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received event network-vif-plugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Acquiring lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Lock "9da338fc-f979-4df6-b83e-8cb78f97ac2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] No waiting events found dispatching network-vif-plugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:41:13 user nova-compute[71507]: WARNING nova.compute.manager [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Received unexpected event network-vif-plugged-9bc79b2b-d5b5-4f9e-8bfe-6fb5ef555b4d for instance with vm_state deleted and task_state None.
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-unplugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] No waiting events found dispatching network-vif-unplugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-unplugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Acquiring lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] Lock "32b179d3-712f-47bc-94ad-387c8ca77380-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.compute.manager [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] No waiting events found dispatching network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:41:13 user nova-compute[71507]: WARNING nova.compute.manager [req-1dc8c56a-d211-4cc9-8d04-a88894109a24 req-d6826ef0-22dd-4013-a548-94b85fb47c45 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received unexpected event network-vif-plugged-1cb2ae52-e4fa-4627-b3f3-301af5732358 for instance with vm_state active and task_state deleting.
Apr 13 15:41:13 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Took 0.83 seconds to deallocate network for instance.
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:41:13 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:13 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Deleted allocations for instance 32b179d3-712f-47bc-94ad-387c8ca77380
Apr 13 15:41:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-66ae3247-ba5e-4d04-8ee7-14bd86c6ac9f tempest-AttachVolumeShelveTestJSON-1608248430 tempest-AttachVolumeShelveTestJSON-1608248430-project-member] Lock "32b179d3-712f-47bc-94ad-387c8ca77380" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.847s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-233295cd-570f-4a24-b982-d91a35e6a53e req-8c56a83d-6fa0-4ebf-86f4-9b2627f58ea2 service nova] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Received event network-vif-deleted-1cb2ae52-e4fa-4627-b3f3-301af5732358 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "4a17bf49-ffae-4178-b484-6c45bd80fb12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:15 user nova-compute[71507]: INFO nova.compute.manager [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Terminating instance
Apr 13 15:41:15 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received event network-vif-unplugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] Acquiring lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] No waiting events found dispatching network-vif-unplugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-12da10c2-b540-4b47-996e-264a3ed8e1ff req-2e70f6b5-1253-499b-9a40-f7596232d785 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received event network-vif-unplugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received event network-changed-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Refreshing instance network info cache due to event network-changed-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] Acquiring lock "refresh_cache-4a17bf49-ffae-4178-b484-6c45bd80fb12" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] Acquired lock "refresh_cache-4a17bf49-ffae-4178-b484-6c45bd80fb12" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:41:15 user nova-compute[71507]: DEBUG nova.network.neutron [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Refreshing network info cache for port 1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:41:16 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Instance destroyed successfully.
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'resources' on Instance uuid 4a17bf49-ffae-4178-b484-6c45bd80fb12 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1423782443',display_name='tempest-TestVolumeBootPattern-server-1423782443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1423782443',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA==',key_name='tempest-TestVolumeBootPattern-534201410',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-205bagyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:39:36Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=4a17bf49-ffae-4178-b484-6c45bd80fb12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:69:44,bridge_name='br-int',has_traffic_filtering=True,id=1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dee69e3-2a') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_vif [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:69:44,bridge_name='br-int',has_traffic_filtering=True,id=1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dee69e3-2a') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dee69e3-2a, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:41:16 user nova-compute[71507]: INFO os_vif [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:69:44,bridge_name='br-int',has_traffic_filtering=True,id=1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dee69e3-2a')
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtFEQnMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:41:16 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a3840c-8249-4aab-bc4d-a52f63922fa7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:41:16 user nova-compute[71507]: No targets found.
Apr 13 15:41:16 user nova-compute[71507]: iSNS:
Apr 13 15:41:16 user nova-compute[71507]: No targets found.
Apr 13 15:41:16 user nova-compute[71507]: STATIC:
Apr 13 15:41:16 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8
Apr 13 15:41:16 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:41:16 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:41:16 user nova-compute[71507]: FIRMWARE:
Apr 13 15:41:16 user nova-compute[71507]: No targets found.
Apr 13 15:41:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:41:16 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:41:16 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42bcc93-22c5-49ce-bdce-ea480fb7e16f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a56825b-bfcf-42ba-bc0c-f408bc0366b8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:41:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:41:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c662320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d82e29-60bd-4576-b5ee-ec278721578a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d82f7d4-28ce-487d-9fc7-d82c6acd12dc]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6b978b-62cd-4db3-ade6-d7714c2e9f09]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be43258-dfec-4058-8b75-84bccef4c999]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4273a0ed', '/dev/disk/by-id/scsi-23537363631666363', '/dev/disk/by-id/scsi-1SCST_BIO4273a0ed-57661fcc3d389b3e') {{(pid=81901) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dd0cc8-4d6c-4232-aea5-74581a4af9ae]: (4, None) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.network.neutron [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Updated VIF entry in instance network info cache for port 1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.network.neutron [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Updating instance_info_cache with network_info: [{"id": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "address": "fa:16:3e:c5:69:44", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dee69e3-2a", "ovs_interfaceid": "1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a96b22e-2664-453c-90c1-256b1fd1a6ca]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bd84ed6d-7da2-474e-99ae-dc8af4511bde req-42e01a3a-c9e2-4d63-a058-fd37f67eca80 service nova] Releasing lock "refresh_cache-4a17bf49-ffae-4178-b484-6c45bd80fb12" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c86554d-68be-432b-9d40-01d3c904a56a]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260]
Apr 13 15:41:16 user nova-compute[71507]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260] successful.
Apr 13 15:41:16 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7b915f-78c2-4932-ae05-75776021a2a1]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== disconnect_volume: return (300ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:41:16 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Deleting instance files /opt/stack/data/nova/instances/4a17bf49-ffae-4178-b484-6c45bd80fb12_del
Apr 13 15:41:16 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Deletion of /opt/stack/data/nova/instances/4a17bf49-ffae-4178-b484-6c45bd80fb12_del complete
Apr 13 15:41:16 user nova-compute[71507]: INFO nova.compute.manager [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 13 15:41:16 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:41:16 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:41:17 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:41:17 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Took 0.76 seconds to deallocate network for instance.
Apr 13 15:41:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f3ef1aa-541d-44e2-94c4-5d9305b44c6d req-f6f916f7-f35f-4a8a-8220-9d7193279ca0 service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received event network-vif-deleted-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received event network-vif-plugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:41:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] Acquiring lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] No waiting events found dispatching network-vif-plugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:41:17 user nova-compute[71507]: WARNING nova.compute.manager [req-b47f4a87-5380-45b8-a9b5-2961b80a4301 req-ac4ec799-0ab5-46c2-b7a7-21637081024e service nova] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Received unexpected event network-vif-plugged-1dee69e3-2ae1-40b4-bb0f-b8caf3528bb1 for instance with vm_state active and task_state deleting.
Apr 13 15:41:18 user nova-compute[71507]: INFO nova.compute.manager [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Took 0.86 seconds to detach 1 volumes for instance.
Apr 13 15:41:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:18 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:41:18 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:41:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:18 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Deleted allocations for instance 4a17bf49-ffae-4178-b484-6c45bd80fb12
Apr 13 15:41:18 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7263d904-c750-43d5-a551-a79f12919448 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "4a17bf49-ffae-4178-b484-6c45bd80fb12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.196s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:27 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400472.1467268, 9da338fc-f979-4df6-b83e-8cb78f97ac2c => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:41:27 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] VM Stopped (Lifecycle Event)
Apr 13 15:41:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-cde1cc87-8efd-4abd-bda8-742bf7e2e536 None None] [instance: 9da338fc-f979-4df6-b83e-8cb78f97ac2c] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:41:27 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400472.7641892, 32b179d3-712f-47bc-94ad-387c8ca77380 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:41:27 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] VM Stopped (Lifecycle Event)
Apr 13 15:41:27 user nova-compute[71507]: DEBUG nova.compute.manager [None req-e0c92b53-b921-45bc-aee2-ca4fd0b34c8d None None] [instance: 32b179d3-712f-47bc-94ad-387c8ca77380] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:28 user nova-compute[71507]: INFO nova.compute.manager [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attaching volume fe9ec691-ca66-4f4b-bdbd-9ce535037db7 to /dev/vdb
Apr 13 15:41:28 user nova-compute[71507]: DEBUG os_brick.utils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8b1a65-65ae-4f93-a856-5080b3aa3e31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b1d5ae-acfe-444e-8e7d-9da16cbfb22e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac45a8-0fe4-4de4-bace-80a57434a267]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4ffcc4-0fe8-4fbd-be8f-c7783df4d9dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:41:28 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:41:28 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7203a901-52da-48fe-9ada-9483bdc07c97]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG os_brick.utils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating existing volume attachment record: 6e2be0ff-7657-4512-a2c3-80117c074078 {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:41:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:31 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400476.0752094, 4a17bf49-ffae-4178-b484-6c45bd80fb12 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:41:31 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] VM Stopped (Lifecycle Event)
Apr 13 15:41:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:31 user nova-compute[71507]: DEBUG nova.compute.manager [None req-948a3369-c946-49d4-bcd9-560a2124d884 None None] [instance: 4a17bf49-ffae-4178-b484-6c45bd80fb12] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHehfBkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:41:32 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:41:32 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:41:32 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[658553e6-19d6-4be9-b706-dd9c6ae20562]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:41:32 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7144abaa-d16c-4a99-99ce-e277f9a1e8ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7] added
Apr 13 15:41:32 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb18023-334a-43e5-a712-0242f249b9d7]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[641aa99a-03c8-491d-ba35-e5716d17e281]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHehfBkY {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHehfBkY" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e08c6e-d289-42c3-860e-a28b8a07141c]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHehfBkY'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbeeb50-5d82-4957-b7db-ac44e61a4a8b]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a42627c-2947-4954-acc9-1cbdc64fed1e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:41:32 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:32 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:41:32 user nova-compute[71507]:  {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:41:32 user nova-compute[71507]: WARNING os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 15:41:32 user nova-compute[71507]: 
Apr 13 15:41:32 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --login" returned: 0 in 1.046s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:33 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b530945-609b-453f-a673-f571ce32f43d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:33 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7, portal: 172.16.0.220,3260]
Apr 13 15:41:33 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7, portal: 172.16.0.220,3260] successful.
Apr 13 15:41:33 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:33 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[011fa36c-66d9-4e38-b310-a5ce550b9722]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d115af2f-8552-4a77-8ffb-5b95638d1866]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 (non-flash)
Apr 13 15:41:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 (non-flash)
Apr 13 15:41:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.256s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[441ec444-1fc9-490f-a779-fd4dac124d89]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:41:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHehfBkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:41:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.284s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:41:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== connect_volume: return (2286ms) {'type': 'block', 'scsi_wwn': '23030313038313430', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:41:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030313038313430', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:41:35 user nova-compute[71507]: DEBUG nova.objects.instance [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:41:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:41:35 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:41:35 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:41:35 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:41:35 user nova-compute[71507]:   <serial>fe9ec691-ca66-4f4b-bdbd-9ce535037db7</serial>
Apr 13 15:41:35 user nova-compute[71507]: </disk>
Apr 13 15:41:35 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:41:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:41:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:41:35 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No VIF found with MAC fa:16:3e:db:92:0d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:41:35 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-9eeddb92-1a5b-426a-8f3e-aeb41553925a tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.408s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:36 user nova-compute[71507]: INFO nova.compute.manager [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Detaching volume fe9ec691-ca66-4f4b-bdbd-9ce535037db7
Apr 13 15:41:36 user nova-compute[71507]: INFO nova.virt.block_device [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attempting to driver detach volume fe9ec691-ca66-4f4b-bdbd-9ce535037db7 from mountpoint /dev/vdb
Apr 13 15:41:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Attempting to detach device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:41:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:41:36 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:41:36 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:41:36 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:41:36 user nova-compute[71507]:   <serial>fe9ec691-ca66-4f4b-bdbd-9ce535037db7</serial>
Apr 13 15:41:36 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:41:36 user nova-compute[71507]: </disk>
Apr 13 15:41:36 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:41:36 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully detached device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the persistent domain config.
Apr 13 15:41:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:41:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:41:36 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:41:36 user nova-compute[71507]:   <source dev="/dev/sdb"/>
Apr 13 15:41:36 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:41:36 user nova-compute[71507]:   <serial>fe9ec691-ca66-4f4b-bdbd-9ce535037db7</serial>
Apr 13 15:41:36 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:41:36 user nova-compute[71507]: </disk>
Apr 13 15:41:36 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681400497.0531282, dccdbfbe-1261-490e-b8bf-b06e46d42f37 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:41:37 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully detached device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the live domain config.
Apr 13 15:41:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHehfBkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:41:37 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c2a00-5e62-4eb2-9946-1e814be71c41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:41:37 user nova-compute[71507]: No targets found.
Apr 13 15:41:37 user nova-compute[71507]: iSNS:
Apr 13 15:41:37 user nova-compute[71507]: No targets found.
Apr 13 15:41:37 user nova-compute[71507]: STATIC:
Apr 13 15:41:37 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7
Apr 13 15:41:37 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:41:37 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:41:37 user nova-compute[71507]: FIRMWARE:
Apr 13 15:41:37 user nova-compute[71507]: No targets found.
Apr 13 15:41:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:41:37 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:41:37 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[058db16f-ab71-473b-91b9-6fbcf51e9725]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e92f4f2-fe0d-4e63-b37e-f239d841a619]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 (non-flash)
Apr 13 15:41:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 (non-flash)
Apr 13 15:41:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab289a2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba47521-623a-4eec-a513-f73f88781fa5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cfb1aa-d695-44da-b274-e6c16a6602e4]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[755e77a4-214c-4090-8a52-1f4b38ea324d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8093ef8-0dab-4ed3-a77a-180971c4f8a7]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[23701e4f-38f3-4b6e-bcfb-27ef7cd7b0e9]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[18de4bf4-c77f-4216-b705-21a802b6ee99]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7, portal: 172.16.0.220,3260]
Apr 13 15:41:37 user nova-compute[71507]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7, portal: 172.16.0.220,3260] successful.
Apr 13 15:41:37 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9ec691-ca66-4f4b-bdbd-9ce535037db7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cb9589-fd2b-43b7-8d67-1a9fb5981266]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== disconnect_volume: return (295ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:41:37 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:41:38 user nova-compute[71507]: DEBUG nova.objects.instance [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:41:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-983e652a-9ef8-4bac-8c71-0fefc3a479a6 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.623s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:41:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:41:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:41:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:45 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:41:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.007s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:45 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:41:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:41:45 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:46 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:41:46 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:41:46 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=26.055397033691406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:41:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:41:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:41:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:49 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:41:49 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:41:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:51 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:41:51 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:41:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:41:54 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:41:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:41:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:41:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:41:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:41:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:41:56 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:02 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:42:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "53fa5a01-9d0a-480b-b1d3-028930c0e560" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:06 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:42:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:06 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:06 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:42:06 user nova-compute[71507]: INFO nova.compute.claims [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Claim successful on node user
Apr 13 15:42:07 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:42:07 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:42:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:42:07 user nova-compute[71507]: INFO nova.virt.block_device [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Booting with volume 0a9e3ad7-579a-414a-8143-d36ef6b41bf8 at /dev/vda
Apr 13 15:42:07 user nova-compute[71507]: DEBUG nova.policy [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG os_brick.utils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a17ba-9e4b-4cce-a4b2-1c341cbb225a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd1a062-cbf0-4050-8e8c-c06e688538ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fd50a3-f44a-4142-bf06-7fc01021e283]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c06b26b-6b9a-426a-be2c-d6c9b2f00cc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:42:07 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:42:07 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8dbda-edc3-4cf5-9cc6-c8ad658a6bcf]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG os_brick.utils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:42:07 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updating existing volume attachment record: 9e1bec7b-be42-4afb-89b9-c298d27cec2e {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:42:08 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Successfully created port: 9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Successfully updated port: 9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquired lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received event network-changed-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG nova.compute.manager [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Refreshing instance network info cache due to event network-changed-9fd4d123-8854-4643-8716-914a4c5694e3. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] Acquiring lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updating instance_info_cache with network_info: [{"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Releasing lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Instance network_info: |[{"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] Acquired lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:42:09 user nova-compute[71507]: DEBUG nova.network.neutron [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Refreshing network info cache for port 9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:42:10 user nova-compute[71507]: DEBUG nova.network.neutron [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updated VIF entry in instance network info cache for port 9fd4d123-8854-4643-8716-914a4c5694e3. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:42:10 user nova-compute[71507]: DEBUG nova.network.neutron [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updating instance_info_cache with network_info: [{"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:42:10 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-bccdd63e-b338-4a72-9200-2de025659207 req-d5ba0bc2-3005-4a3d-abaf-dae1702d7204 service nova] Releasing lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:42:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:42:12 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Creating image(s)
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Ensure instance console log exists: /opt/stack/data/nova/instances/53fa5a01-9d0a-480b-b1d3-028930c0e560/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Start _get_guest_xml network_info=[{"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtFEQnMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53fa5a01-9d0a-480b-b1d3-028930c0e560', 'attached_at': '', 'detached_at': '', 'volume_id': '0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'serial': '0a9e3ad7-579a-414a-8143-d36ef6b41bf8'}, 'attachment_id': '9e1bec7b-be42-4afb-89b9-c298d27cec2e', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:42:12 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:42:12 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtFEQnMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:42:12 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:42:12 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:42:12 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a37afd-8b91-4beb-b32c-10de09e3e843]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:42:12 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875c0dd-3bb0-4f97-a584-894ae020d12a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8] added
Apr 13 15:42:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f624e9b-ffd8-4b6e-824a-5f8f85e8f904]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[374b0fd7-4f04-495c-b46e-0ffd8077b40a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtFEQnMA {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtFEQnMA" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a6a78b-f3a4-4054-b59b-fdd3b92baa98]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtFEQnMA'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4332031d-18a4-4110-876b-f8b02c257906]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ef59fc-e2aa-497a-a818-c6367b05b08c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:42:12 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 15:42:12 user nova-compute[71507]:  {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:42:12 user nova-compute[71507]: WARNING os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 15:42:12 user nova-compute[71507]: 
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea37b54c-ad59-4f6c-8dd6-4efa8ac6802f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260]
Apr 13 15:42:12 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260] successful.
Apr 13 15:42:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c57ca5-73dc-4c29-8c5b-0f2e811e45ab]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6fad24-b8d9-4ef3-90f3-dba494087508]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:42:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:42:12 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2557b0-42b8-4afb-97b8-cace12d82760]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:42:12 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtFEQnMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23537363631666363', 'path': '/dev/sdb'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537363631666363', 'path': '/dev/sdb'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109801531',display_name='tempest-TestVolumeBootPattern-server-109801531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-109801531',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA==',key_name='tempest-TestVolumeBootPattern-534201410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-f6y6xkcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:42:07Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=53fa5a01-9d0a-480b-b1d3-028930c0e560,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:fb:74,bridge_name='br-int',has_traffic_filtering=True,id=9fd4d123-8854-4643-8716-914a4c5694e3,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd4d123-88') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'pci_devices' on Instance uuid 53fa5a01-9d0a-480b-b1d3-028930c0e560 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:42:13 user nova-compute[71507]:   <uuid>53fa5a01-9d0a-480b-b1d3-028930c0e560</uuid>
Apr 13 15:42:13 user nova-compute[71507]:   <name>instance-0000002e</name>
Apr 13 15:42:13 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:42:13 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:42:13 user nova-compute[71507]:   <metadata>
Apr 13 15:42:13 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:42:13 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:42:13 user nova-compute[71507]:       <nova:name>tempest-TestVolumeBootPattern-server-109801531</nova:name>
Apr 13 15:42:13 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:42:12</nova:creationTime>
Apr 13 15:42:13 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:42:13 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:42:13 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:42:13 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:42:13 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:42:13 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:42:13 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:42:13 user nova-compute[71507]:       <nova:owner>
Apr 13 15:42:13 user nova-compute[71507]:         <nova:user uuid="0307fb8d127a41079e34355904352231">tempest-TestVolumeBootPattern-374778702-project-member</nova:user>
Apr 13 15:42:13 user nova-compute[71507]:         <nova:project uuid="d5d7f771264c4cd2bc595a2c525082d0">tempest-TestVolumeBootPattern-374778702</nova:project>
Apr 13 15:42:13 user nova-compute[71507]:       </nova:owner>
Apr 13 15:42:13 user nova-compute[71507]:       <nova:ports>
Apr 13 15:42:13 user nova-compute[71507]:         <nova:port uuid="9fd4d123-8854-4643-8716-914a4c5694e3">
Apr 13 15:42:13 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 15:42:13 user nova-compute[71507]:         </nova:port>
Apr 13 15:42:13 user nova-compute[71507]:       </nova:ports>
Apr 13 15:42:13 user nova-compute[71507]:     </nova:instance>
Apr 13 15:42:13 user nova-compute[71507]:   </metadata>
Apr 13 15:42:13 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:42:13 user nova-compute[71507]:     <system>
Apr 13 15:42:13 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:42:13 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:42:13 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:42:13 user nova-compute[71507]:       <entry name="serial">53fa5a01-9d0a-480b-b1d3-028930c0e560</entry>
Apr 13 15:42:13 user nova-compute[71507]:       <entry name="uuid">53fa5a01-9d0a-480b-b1d3-028930c0e560</entry>
Apr 13 15:42:13 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:42:13 user nova-compute[71507]:     </system>
Apr 13 15:42:13 user nova-compute[71507]:   </sysinfo>
Apr 13 15:42:13 user nova-compute[71507]:   <os>
Apr 13 15:42:13 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:42:13 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:42:13 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:42:13 user nova-compute[71507]:   </os>
Apr 13 15:42:13 user nova-compute[71507]:   <features>
Apr 13 15:42:13 user nova-compute[71507]:     <acpi/>
Apr 13 15:42:13 user nova-compute[71507]:     <apic/>
Apr 13 15:42:13 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:42:13 user nova-compute[71507]:   </features>
Apr 13 15:42:13 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:42:13 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:42:13 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:42:13 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:42:13 user nova-compute[71507]:   </clock>
Apr 13 15:42:13 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:42:13 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:42:13 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:42:13 user nova-compute[71507]:   </cpu>
Apr 13 15:42:13 user nova-compute[71507]:   <devices>
Apr 13 15:42:13 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:42:13 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:42:13 user nova-compute[71507]:       <source dev="/dev/sdb"/>
Apr 13 15:42:13 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:42:13 user nova-compute[71507]:       <serial>0a9e3ad7-579a-414a-8143-d36ef6b41bf8</serial>
Apr 13 15:42:13 user nova-compute[71507]:     </disk>
Apr 13 15:42:13 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:42:13 user nova-compute[71507]:       <mac address="fa:16:3e:69:fb:74"/>
Apr 13 15:42:13 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:42:13 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:42:13 user nova-compute[71507]:       <target dev="tap9fd4d123-88"/>
Apr 13 15:42:13 user nova-compute[71507]:     </interface>
Apr 13 15:42:13 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:42:13 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/53fa5a01-9d0a-480b-b1d3-028930c0e560/console.log" append="off"/>
Apr 13 15:42:13 user nova-compute[71507]:     </serial>
Apr 13 15:42:13 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:42:13 user nova-compute[71507]:     <video>
Apr 13 15:42:13 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:42:13 user nova-compute[71507]:     </video>
Apr 13 15:42:13 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:42:13 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:42:13 user nova-compute[71507]:     </rng>
Apr 13 15:42:13 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:42:13 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:42:13 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:42:13 user nova-compute[71507]:     </memballoon>
Apr 13 15:42:13 user nova-compute[71507]:   </devices>
Apr 13 15:42:13 user nova-compute[71507]: </domain>
Apr 13 15:42:13 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109801531',display_name='tempest-TestVolumeBootPattern-server-109801531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-109801531',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA==',key_name='tempest-TestVolumeBootPattern-534201410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-f6y6xkcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:42:07Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=53fa5a01-9d0a-480b-b1d3-028930c0e560,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:fb:74,bridge_name='br-int',has_traffic_filtering=True,id=9fd4d123-8854-4643-8716-914a4c5694e3,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd4d123-88') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG os_vif [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:fb:74,bridge_name='br-int',has_traffic_filtering=True,id=9fd4d123-8854-4643-8716-914a4c5694e3,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd4d123-88') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fd4d123-88, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fd4d123-88, col_values=(('external_ids', {'iface-id': '9fd4d123-8854-4643-8716-914a4c5694e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:fb:74', 'vm-uuid': '53fa5a01-9d0a-480b-b1d3-028930c0e560'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:13 user nova-compute[71507]: INFO os_vif [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:fb:74,bridge_name='br-int',has_traffic_filtering=True,id=9fd4d123-8854-4643-8716-914a4c5694e3,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd4d123-88')
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:42:13 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No VIF found with MAC fa:16:3e:69:fb:74, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:42:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received event network-vif-plugged-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:42:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] Acquiring lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:15 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:15 user nova-compute[71507]: DEBUG nova.compute.manager [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] No waiting events found dispatching network-vif-plugged-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:42:15 user nova-compute[71507]: WARNING nova.compute.manager [req-0b8739d1-fbd1-4c91-92f9-4a3fe3e18bea req-ad2a3781-ff79-459d-a422-2900cb544f02 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received unexpected event network-vif-plugged-9fd4d123-8854-4643-8716-914a4c5694e3 for instance with vm_state building and task_state spawning.
Apr 13 15:42:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:15 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400537.360481, 53fa5a01-9d0a-480b-b1d3-028930c0e560 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:42:17 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] VM Resumed (Lifecycle Event)
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:42:17 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Instance spawned successfully.
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received event network-vif-plugged-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] Acquiring lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.compute.manager [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] No waiting events found dispatching network-vif-plugged-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:42:17 user nova-compute[71507]: WARNING nova.compute.manager [req-e6e107e1-4fed-470f-881b-bbe1ae146144 req-380335b3-10c1-4ef9-9b39-ace864db3c97 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received unexpected event network-vif-plugged-9fd4d123-8854-4643-8716-914a4c5694e3 for instance with vm_state building and task_state spawning.
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:42:17 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400537.3651614, 53fa5a01-9d0a-480b-b1d3-028930c0e560 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:42:17 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] VM Started (Lifecycle Event)
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:42:17 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:42:17 user nova-compute[71507]: INFO nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Took 5.20 seconds to spawn the instance on the hypervisor.
Apr 13 15:42:17 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:42:17 user nova-compute[71507]: INFO nova.compute.manager [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Took 10.66 seconds to build instance.
Apr 13 15:42:17 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7c856db5-3e5e-4056-ae5d-987e974db91e tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.755s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:42:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:42:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:42:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:42:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:29 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:42:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:29 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:29 user nova-compute[71507]: INFO nova.compute.manager [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attaching volume ba76dc10-d310-49d5-983c-7b6a11cc28ef to /dev/vdb
Apr 13 15:42:30 user nova-compute[71507]: DEBUG os_brick.utils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b84e15a-f90b-4544-90ab-22d72231d882]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db41f533-5cad-460b-bff6-f07c592a9632]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a27551-cc35-4569-a2d1-4ec8a5973241]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ad73dd-6fca-4945-afaa-24ca23c79812]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:42:30 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:42:30 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a103b8-8d68-439f-be03-786fbba326cd]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG os_brick.utils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:42:30 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating existing volume attachment record: dda3e4b4-694d-42e1-94be-d2fc3f269e9c {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:42:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZUPmBLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:42:34 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:42:34 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:42:34 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[129874e8-c572-4983-b4e3-91bb03afbfad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:42:34 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[291d0b19-c687-4b74-8147-cc3bf62d8c1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef] added
Apr 13 15:42:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada8121a-3dba-490e-9825-1c764d8bfe49]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c514e-6b4e-447e-ac72-482b3c308044]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZUPmBLE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZUPmBLE" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f178f5-851f-4591-af5d-250c6c24124e]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gZUPmBLE'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9c8abc-102a-40b2-ba2e-379daecc96e5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea38041-f2f7-4989-9fc0-75ba91f8e9cc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:42:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:42:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbc4921-d913-4c3a-891f-149bb8d2ff5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef, portal: 172.16.0.220,3260]
Apr 13 15:42:34 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef, portal: 172.16.0.220,3260] successful.
Apr 13 15:42:34 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:34 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8220d6-435e-4455-87c4-34c29419d803]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7df669c-a5bd-4494-ab41-df81fa6f8a9e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:42:35 user nova-compute[71507]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef (non-flash)
Apr 13 15:42:35 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:42:35 user nova-compute[71507]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef (non-flash)
Apr 13 15:42:35 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa28d3d1-e020-454a-b846-38480b3e77c6]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:42:35 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZUPmBLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:42:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:42:36 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23837386133623862', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:42:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837386133623862', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:42:36 user nova-compute[71507]: DEBUG nova.objects.instance [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:42:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 15:42:36 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:42:36 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:42:36 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:42:36 user nova-compute[71507]:   <serial>ba76dc10-d310-49d5-983c-7b6a11cc28ef</serial>
Apr 13 15:42:36 user nova-compute[71507]: </disk>
Apr 13 15:42:36 user nova-compute[71507]:  {{(pid=71507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 15:42:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:42:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:42:36 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] No VIF found with MAC fa:16:3e:db:92:0d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:42:36 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-b57adc39-1d1b-430f-a847-b0289b804dfb tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.808s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:38 user nova-compute[71507]: INFO nova.compute.manager [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Detaching volume ba76dc10-d310-49d5-983c-7b6a11cc28ef
Apr 13 15:42:38 user nova-compute[71507]: INFO nova.virt.block_device [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Attempting to driver detach volume ba76dc10-d310-49d5-983c-7b6a11cc28ef from mountpoint /dev/vdb
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Attempting to detach device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the persistent domain config. {{(pid=71507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:42:38 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:42:38 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:42:38 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:42:38 user nova-compute[71507]:   <serial>ba76dc10-d310-49d5-983c-7b6a11cc28ef</serial>
Apr 13 15:42:38 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:42:38 user nova-compute[71507]: </disk>
Apr 13 15:42:38 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:42:38 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully detached device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the persistent domain config.
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the live domain config. {{(pid=71507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.guest [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 15:42:38 user nova-compute[71507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:42:38 user nova-compute[71507]:   <source dev="/dev/sdc"/>
Apr 13 15:42:38 user nova-compute[71507]:   <target dev="vdb" bus="virtio"/>
Apr 13 15:42:38 user nova-compute[71507]:   <serial>ba76dc10-d310-49d5-983c-7b6a11cc28ef</serial>
Apr 13 15:42:38 user nova-compute[71507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 15:42:38 user nova-compute[71507]: </disk>
Apr 13 15:42:38 user nova-compute[71507]:  {{(pid=71507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Received event <DeviceRemovedEvent: 1681400558.7398505, dccdbfbe-1261-490e-b8bf-b06e46d42f37 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71507) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 15:42:38 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully detached device vdb from instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 from the live domain config.
Apr 13 15:42:38 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZUPmBLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:42:38 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9a2e96-4d87-44a1-82e3-01796d2877b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:42:38 user nova-compute[71507]: No targets found.
Apr 13 15:42:38 user nova-compute[71507]: iSNS:
Apr 13 15:42:38 user nova-compute[71507]: No targets found.
Apr 13 15:42:38 user nova-compute[71507]: STATIC:
Apr 13 15:42:38 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef
Apr 13 15:42:38 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:42:38 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:42:38 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8
Apr 13 15:42:38 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:42:38 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:42:38 user nova-compute[71507]: FIRMWARE:
Apr 13 15:42:38 user nova-compute[71507]: No targets found.
Apr 13 15:42:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:42:38 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:42:38 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7912ee-09b3-444a-a2e4-be8390786776]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d312266d-8d32-474c-b376-1a2283d81464]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:42:38 user nova-compute[71507]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef (non-flash)
Apr 13 15:42:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:42:38 user nova-compute[71507]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef (non-flash)
Apr 13 15:42:38 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1426ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e26ebc6-e337-4d50-beaa-39ab1016584c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a02f0-a30b-4e5e-8f58-fba089414fd7]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[31231baa-cba4-4bea-a4a4-af48188fd20a]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c76b29-6798-439e-8af9-5bd383aa8be2]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d818f-f2b3-43dc-8f66-0876a88bced5]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:38 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6efd1b-6cf5-42ba-a4f0-af28ec2d4210]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef, portal: 172.16.0.220,3260]
Apr 13 15:42:39 user nova-compute[71507]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef, portal: 172.16.0.220,3260] successful.
Apr 13 15:42:39 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba76dc10-d310-49d5-983c-7b6a11cc28ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eec9da8-ba67-4853-bc4b-c6475c087105]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] <== disconnect_volume: return (330ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating instance_info_cache with network_info: [{"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:42:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:42:40 user nova-compute[71507]: DEBUG nova.objects.instance [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'flavor' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:42:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-c0b8e711-4382-44ce-9ac1-c8386d330ebd tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.073s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:42:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:42:47 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:42:47 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:42:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=26.04184341430664GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:42:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:42:48 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:42:51 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:51 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:51 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:42:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:42:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:42:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:42:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:42:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:42:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:56 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:57 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:42:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:43:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:43:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:43:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.005s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.002s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Verify base images {{(pid=71507) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71507) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Image id 90e5cdd0-62b7-441b-9971-cfa8e8a0478d yields fingerprint 07220e8de85ad46dae3aeb249f710a67925ee918 {{(pid=71507) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] image 90e5cdd0-62b7-441b-9971-cfa8e8a0478d at (/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918): checking
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] image 90e5cdd0-62b7-441b-9971-cfa8e8a0478d at (/opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918): image is in use {{(pid=71507) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] 53fa5a01-9d0a-480b-b1d3-028930c0e560 is a valid instance name {{(pid=71507) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] dccdbfbe-1261-490e-b8bf-b06e46d42f37 is a valid instance name {{(pid=71507) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] dccdbfbe-1261-490e-b8bf-b06e46d42f37 has a disk file {{(pid=71507) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance dccdbfbe-1261-490e-b8bf-b06e46d42f37 is backed by 07220e8de85ad46dae3aeb249f710a67925ee918 {{(pid=71507) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 15:43:12 user nova-compute[71507]: WARNING nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Unknown base file: /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047
Apr 13 15:43:12 user nova-compute[71507]: WARNING nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Unknown base file: /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58
Apr 13 15:43:12 user nova-compute[71507]: WARNING nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947
Apr 13 15:43:12 user nova-compute[71507]: WARNING nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Unknown base file: /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13
Apr 13 15:43:12 user nova-compute[71507]: WARNING nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b
Apr 13 15:43:12 user nova-compute[71507]: WARNING nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Unknown base file: /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1
Apr 13 15:43:12 user nova-compute[71507]: WARNING nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Unknown base file: /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca
Apr 13 15:43:12 user nova-compute[71507]: WARNING nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Unknown base file: /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11
Apr 13 15:43:12 user nova-compute[71507]: WARNING nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Unknown base file: /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Active base files: /opt/stack/data/nova/instances/_base/07220e8de85ad46dae3aeb249f710a67925ee918
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Removable base files: /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047 /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58 /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947 /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13 /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1 /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11 /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/397647af823b1939ff5134772f0cd89fd13b8047
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d46823831e62ebe8fd67894abc9ebb89d1758c58
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee397e8e00ac6cd514b7cb93644ed8a18e308947
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/456be0b2f334e9d25db2e576f9535290185dfc13
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d47881aa93b13f3ef1f3283b23a1cc4c56a870b
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1f59a8aac6c4890ef0aae4cf870b2343c176bee1
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/144ac4559a95d46294b43255c5e57220fa4e30ca
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5a2552e2f319d1cf866c4780264c56b3886dee11
Apr 13 15:43:12 user nova-compute[71507]: INFO nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c7432199be95c303a0a9c8e65c1330ec691d6c84
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Verification complete {{(pid=71507) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Verify swap images {{(pid=71507) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 13 15:43:12 user nova-compute[71507]: DEBUG nova.virt.libvirt.imagecache [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Verify ephemeral images {{(pid=71507) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 13 15:43:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:17 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:43:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:43:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:43:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:39 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:43:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:43:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:43:39 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:43:40 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updating instance_info_cache with network_info: [{"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:43:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:43:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:43:41 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances with incomplete migration  {{(pid=71507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 15:43:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received event network-changed-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:43:42 user nova-compute[71507]: DEBUG nova.compute.manager [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Refreshing instance network info cache due to event network-changed-bee671f2-48c8-41d0-945c-3c8b796aa286. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:43:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] Acquiring lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:43:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] Acquired lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:43:42 user nova-compute[71507]: DEBUG nova.network.neutron [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Refreshing network info cache for port bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG nova.network.neutron [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updated VIF entry in instance network info cache for port bee671f2-48c8-41d0-945c-3c8b796aa286. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG nova.network.neutron [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating instance_info_cache with network_info: [{"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f51ddfb5-a7c8-4e38-897a-c0bc09f2ca2a req-2cdb2902-36c0-4006-a2f2-fe995afe790d service nova] Releasing lock "refresh_cache-dccdbfbe-1261-490e-b8bf-b06e46d42f37" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Cleaning up deleted instances {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] There are 0 instances to clean {{(pid=71507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:43:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:43:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:43:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:43:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:43:44 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:43:44 user nova-compute[71507]: INFO nova.compute.manager [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Terminating instance
Apr 13 15:43:44 user nova-compute[71507]: DEBUG nova.compute.manager [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:43:44 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received event network-vif-unplugged-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] No waiting events found dispatching network-vif-unplugged-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG nova.compute.manager [req-5e911cf3-bb7b-4239-9985-7cc553321843 req-e7b52810-0a9f-4c26-939e-0af1efbdb643 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received event network-vif-unplugged-bee671f2-48c8-41d0-945c-3c8b796aa286 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:43:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Instance destroyed successfully.
Apr 13 15:43:45 user nova-compute[71507]: DEBUG nova.objects.instance [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lazy-loading 'resources' on Instance uuid dccdbfbe-1261-490e-b8bf-b06e46d42f37 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1899978738',display_name='tempest-SnapshotDataIntegrityTests-server-1899978738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1899978738',id=43,image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1KlcmjH08ASB6EGqoWCNiRIccnybruptZ8sbR1PLZTq358S36cyJUgy4qa0Lb0HyrKahfHVxBpwpLbc5x22ZY4G+mKj9Fadjm1HmD3fWxrE1krMESQzmxfti/1t4bU2w==',key_name='tempest-SnapshotDataIntegrityTests-1169680877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fc833ca51a84b6789f0def7357d4c59',ramdisk_id='',reservation_id='r-qn3xdg0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90e5cdd0-62b7-441b-9971-cfa8e8a0478d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-965824759',owner_user_name='tempest-SnapshotDataIntegrityTests-965824759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:37:26Z,user_data=None,user_id='af0f7d9513b44bda8e53597cf7751ec0',uuid=dccdbfbe-1261-490e-b8bf-b06e46d42f37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Converting VIF {"id": "bee671f2-48c8-41d0-945c-3c8b796aa286", "address": "fa:16:3e:db:92:0d", "network": {"id": "1f6973b5-16ba-4e7b-ac56-dff73d570d12", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369606805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fc833ca51a84b6789f0def7357d4c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee671f2-48", "ovs_interfaceid": "bee671f2-48c8-41d0-945c-3c8b796aa286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:92:0d,bridge_name='br-int',has_traffic_filtering=True,id=bee671f2-48c8-41d0-945c-3c8b796aa286,network=Network(1f6973b5-16ba-4e7b-ac56-dff73d570d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee671f2-48') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG os_vif [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:92:0d,bridge_name='br-int',has_traffic_filtering=True,id=bee671f2-48c8-41d0-945c-3c8b796aa286,network=Network(1f6973b5-16ba-4e7b-ac56-dff73d570d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee671f2-48') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbee671f2-48, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:45 user nova-compute[71507]: INFO os_vif [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:92:0d,bridge_name='br-int',has_traffic_filtering=True,id=bee671f2-48c8-41d0-945c-3c8b796aa286,network=Network(1f6973b5-16ba-4e7b-ac56-dff73d570d12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee671f2-48')
Apr 13 15:43:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Deleting instance files /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37_del
Apr 13 15:43:45 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Deletion of /opt/stack/data/nova/instances/dccdbfbe-1261-490e-b8bf-b06e46d42f37_del complete
Apr 13 15:43:45 user nova-compute[71507]: INFO nova.compute.manager [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 15:43:45 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:43:45 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:43:46 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Took 0.56 seconds to deallocate network for instance.
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.compute.manager [req-9fb1bb84-e5ad-4095-8d79-27fbe6f509c7 req-0066769d-db0f-4bd9-87bf-1aeec56af992 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received event network-vif-deleted-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Refreshing inventories for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Updating ProviderTree inventory for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Updating inventory in ProviderTree for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Refreshing aggregate associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, aggregates: None {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Refreshing trait associations for resource provider d4bde90d-fb36-4cb3-9849-976dd28e1f71, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2 {{(pid=71507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.239s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:43:46 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Deleted allocations for instance dccdbfbe-1261-490e-b8bf-b06e46d42f37
Apr 13 15:43:46 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received event network-vif-plugged-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] Acquiring lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG nova.compute.manager [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] No waiting events found dispatching network-vif-plugged-bee671f2-48c8-41d0-945c-3c8b796aa286 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:43:47 user nova-compute[71507]: WARNING nova.compute.manager [req-fe04582b-b44c-49fd-8db0-dc5211adf9e7 req-b0924286-a4ba-4191-a633-117cd9d03d83 service nova] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Received unexpected event network-vif-plugged-bee671f2-48c8-41d0-945c-3c8b796aa286 for instance with vm_state deleted and task_state None.
Apr 13 15:43:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-39cc0e9f-4a4c-4ac4-804c-0fa094c2eb32 tempest-SnapshotDataIntegrityTests-965824759 tempest-SnapshotDataIntegrityTests-965824759-project-member] Lock "dccdbfbe-1261-490e-b8bf-b06e46d42f37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.393s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:43:47 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:43:47 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:43:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=26.059001922607422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:43:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:43:49 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:52 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:53 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:43:54 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:43:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:43:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:43:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:43:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:57 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received event network-changed-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:43:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Refreshing instance network info cache due to event network-changed-9fd4d123-8854-4643-8716-914a4c5694e3. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:43:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] Acquiring lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:43:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] Acquired lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:43:58 user nova-compute[71507]: DEBUG nova.network.neutron [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Refreshing network info cache for port 9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:43:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:43:58 user nova-compute[71507]: DEBUG nova.network.neutron [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updated VIF entry in instance network info cache for port 9fd4d123-8854-4643-8716-914a4c5694e3. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:43:58 user nova-compute[71507]: DEBUG nova.network.neutron [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updating instance_info_cache with network_info: [{"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:43:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ba6ac40c-a52d-4d39-b4cd-99429d3e5766 req-9ba41559-951c-41a3-a388-84f5372d24ce service nova] Releasing lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:43:59 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:43:59 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:00 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400625.6474564, dccdbfbe-1261-490e-b8bf-b06e46d42f37 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:44:00 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] VM Stopped (Lifecycle Event)
Apr 13 15:44:00 user nova-compute[71507]: DEBUG nova.compute.manager [None req-019fe7da-8238-46a3-b704-ce24d76244ca None None] [instance: dccdbfbe-1261-490e-b8bf-b06e46d42f37] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:44:00 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:44:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:44:04 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Starting instance... {{(pid=71507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 15:44:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:44:04 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:44:04 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 15:44:04 user nova-compute[71507]: INFO nova.compute.claims [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Claim successful on node user
Apr 13 15:44:05 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Start building networks asynchronously for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Allocating IP information in the background. {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] allocate_for_instance() {{(pid=71507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 15:44:05 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 15:44:05 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Start building block device mappings for instance. {{(pid=71507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 15:44:05 user nova-compute[71507]: INFO nova.virt.block_device [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Booting with volume 29098607-080d-4a0e-afda-65df97acdffe at /dev/vda
Apr 13 15:44:05 user nova-compute[71507]: DEBUG os_brick.utils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2338dd40-3dc6-4939-8696-ddac8c57c84c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d75831c16e13\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG nova.policy [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0307fb8d127a41079e34355904352231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d7f771264c4cd2bc595a2c525082d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71507) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f529189d-6c8d-42e9-98fe-682e632883c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[699c6b76-1fad-44d1-bd3b-44ac72cdf478]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d487cd4b-8129-4119-8b61-82644bdce85b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Running cmd (subprocess): nvme version {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] 'nvme version' failed. Not Retrying. {{(pid=71507) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] nvme not present on system {{(pid=71507) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 15:44:05 user nova-compute[71507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 15:44:05 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[65723634-3fa3-4d3c-843d-0c91558af5dc]: (4, '') {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71507) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.lightos [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] LIGHTOS: no hostnqn found. {{(pid=71507) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG os_brick.utils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d75831c16e13', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG nova.virt.block_device [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updating existing volume attachment record: d6b006a1-d510-49aa-9cd0-747480e9d9de {{(pid=71507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 15:44:05 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:06 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Successfully created port: a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Successfully updated port: a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquired lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Building network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received event network-changed-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG nova.compute.manager [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Refreshing instance network info cache due to event network-changed-a1c8b5ae-b836-48d3-b13f-5a13cfa72876. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] Acquiring lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Instance cache missing network info. {{(pid=71507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG nova.network.neutron [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updating instance_info_cache with network_info: [{"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Releasing lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Instance network_info: |[{"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] Acquired lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:44:07 user nova-compute[71507]: DEBUG nova.network.neutron [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Refreshing network info cache for port a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:44:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updated VIF entry in instance network info cache for port a1c8b5ae-b836-48d3-b13f-5a13cfa72876. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:44:08 user nova-compute[71507]: DEBUG nova.network.neutron [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updating instance_info_cache with network_info: [{"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:44:08 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-19cb758b-6fbf-417a-807d-b335179cc1b0 req-438818d5-bbcb-493a-8bc8-4d2744bbc6e1 service nova] Releasing lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:44:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Start spawning the instance on the hypervisor. {{(pid=71507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Creating instance directory {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 15:44:09 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Creating image(s)
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Did not create local disks {{(pid=71507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Ensure instance console log exists: /opt/stack/data/nova/instances/b2745a5e-fef2-47ac-983d-dfd197fdf8c4/console.log {{(pid=71507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Start _get_guest_xml network_info=[{"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjzYrTUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b2745a5e-fef2-47ac-983d-dfd197fdf8c4', 'attached_at': '', 'detached_at': '', 'volume_id': '29098607-080d-4a0e-afda-65df97acdffe', 'serial': '29098607-080d-4a0e-afda-65df97acdffe'}, 'attachment_id': 'd6b006a1-d510-49aa-9cd0-747480e9d9de', 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 15:44:09 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:44:09 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T15:04:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image limits 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flavor pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Image pref 0:0:0 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Got 1 possible topologies {{(pid=71507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.hardware [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Calling os-brick to attach iSCSI Volume {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjzYrTUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:44:09 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:44:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:44:09 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:44:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:44:09 user nova-compute[71507]: INFO os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[90795bce-b6ec-4f61-9d5a-f9ba2667ea2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 15:44:09 user nova-compute[71507]:  {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --interface default --op new {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f2f09-93d0-4202-adfa-565a63db4da5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe] added\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe] added
Apr 13 15:44:09 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[284062e0-682a-4667-b0f4-7b8a3006bee0]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:09 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e937a62-d5ec-4f05-8deb-bb805604b05d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjzYrTUm {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjzYrTUm" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f41de-eaf0-43f6-81e7-396cbc4e5ad6]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xjzYrTUm'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[756e6866-b7bf-4cac-a92a-126f5084b753]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb284e6-8afd-4dc2-8081-632ce9992984]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:44:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:44:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --login {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3393df-fbf8-45d4-b1d5-ef573a12e97f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe, portal: 172.16.0.220,3260]
Apr 13 15:44:10 user nova-compute[71507]: Login to [iface: default, target: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe, portal: 172.16.0.220,3260] successful.
Apr 13 15:44:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[79476b95-d115-4569-8970-bdaf17986504]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c6fd10-770c-4124-9c61-ed2a3d47e1e3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:44:10 user nova-compute[71507]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe (non-flash)
Apr 13 15:44:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:44:10 user nova-compute[71507]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe (non-flash)
Apr 13 15:44:10 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to 172.16.0.220:3260 {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=71507) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71507) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd91c696-8582-45d9-a67a-2ecd0fe7c8f1]: (4, ('- - 0', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:44:10 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71507) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjzYrTUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71507) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26262343330376638', 'path': '/dev/sdc'} {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262343330376638', 'path': '/dev/sdc'} {{(pid=71507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1669921011',display_name='tempest-TestVolumeBootPattern-server-1669921011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1669921011',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA==',key_name='tempest-TestVolumeBootPattern-534201410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-i27m19cb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:44:05Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=b2745a5e-fef2-47ac-983d-dfd197fdf8c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:7a:3d,bridge_name='br-int',has_traffic_filtering=True,id=a1c8b5ae-b836-48d3-b13f-5a13cfa72876,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c8b5ae-b8') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.objects.instance [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'pci_devices' on Instance uuid b2745a5e-fef2-47ac-983d-dfd197fdf8c4 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] End _get_guest_xml xml=<domain type="kvm">
Apr 13 15:44:11 user nova-compute[71507]:   <uuid>b2745a5e-fef2-47ac-983d-dfd197fdf8c4</uuid>
Apr 13 15:44:11 user nova-compute[71507]:   <name>instance-0000002f</name>
Apr 13 15:44:11 user nova-compute[71507]:   <memory>131072</memory>
Apr 13 15:44:11 user nova-compute[71507]:   <vcpu>1</vcpu>
Apr 13 15:44:11 user nova-compute[71507]:   <metadata>
Apr 13 15:44:11 user nova-compute[71507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 15:44:11 user nova-compute[71507]:       <nova:package version="0.0.0"/>
Apr 13 15:44:11 user nova-compute[71507]:       <nova:name>tempest-TestVolumeBootPattern-server-1669921011</nova:name>
Apr 13 15:44:11 user nova-compute[71507]:       <nova:creationTime>2023-04-13 15:44:09</nova:creationTime>
Apr 13 15:44:11 user nova-compute[71507]:       <nova:flavor name="m1.nano">
Apr 13 15:44:11 user nova-compute[71507]:         <nova:memory>128</nova:memory>
Apr 13 15:44:11 user nova-compute[71507]:         <nova:disk>1</nova:disk>
Apr 13 15:44:11 user nova-compute[71507]:         <nova:swap>0</nova:swap>
Apr 13 15:44:11 user nova-compute[71507]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 15:44:11 user nova-compute[71507]:         <nova:vcpus>1</nova:vcpus>
Apr 13 15:44:11 user nova-compute[71507]:       </nova:flavor>
Apr 13 15:44:11 user nova-compute[71507]:       <nova:owner>
Apr 13 15:44:11 user nova-compute[71507]:         <nova:user uuid="0307fb8d127a41079e34355904352231">tempest-TestVolumeBootPattern-374778702-project-member</nova:user>
Apr 13 15:44:11 user nova-compute[71507]:         <nova:project uuid="d5d7f771264c4cd2bc595a2c525082d0">tempest-TestVolumeBootPattern-374778702</nova:project>
Apr 13 15:44:11 user nova-compute[71507]:       </nova:owner>
Apr 13 15:44:11 user nova-compute[71507]:       <nova:ports>
Apr 13 15:44:11 user nova-compute[71507]:         <nova:port uuid="a1c8b5ae-b836-48d3-b13f-5a13cfa72876">
Apr 13 15:44:11 user nova-compute[71507]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 15:44:11 user nova-compute[71507]:         </nova:port>
Apr 13 15:44:11 user nova-compute[71507]:       </nova:ports>
Apr 13 15:44:11 user nova-compute[71507]:     </nova:instance>
Apr 13 15:44:11 user nova-compute[71507]:   </metadata>
Apr 13 15:44:11 user nova-compute[71507]:   <sysinfo type="smbios">
Apr 13 15:44:11 user nova-compute[71507]:     <system>
Apr 13 15:44:11 user nova-compute[71507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 15:44:11 user nova-compute[71507]:       <entry name="product">OpenStack Nova</entry>
Apr 13 15:44:11 user nova-compute[71507]:       <entry name="version">0.0.0</entry>
Apr 13 15:44:11 user nova-compute[71507]:       <entry name="serial">b2745a5e-fef2-47ac-983d-dfd197fdf8c4</entry>
Apr 13 15:44:11 user nova-compute[71507]:       <entry name="uuid">b2745a5e-fef2-47ac-983d-dfd197fdf8c4</entry>
Apr 13 15:44:11 user nova-compute[71507]:       <entry name="family">Virtual Machine</entry>
Apr 13 15:44:11 user nova-compute[71507]:     </system>
Apr 13 15:44:11 user nova-compute[71507]:   </sysinfo>
Apr 13 15:44:11 user nova-compute[71507]:   <os>
Apr 13 15:44:11 user nova-compute[71507]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 15:44:11 user nova-compute[71507]:     <boot dev="hd"/>
Apr 13 15:44:11 user nova-compute[71507]:     <smbios mode="sysinfo"/>
Apr 13 15:44:11 user nova-compute[71507]:   </os>
Apr 13 15:44:11 user nova-compute[71507]:   <features>
Apr 13 15:44:11 user nova-compute[71507]:     <acpi/>
Apr 13 15:44:11 user nova-compute[71507]:     <apic/>
Apr 13 15:44:11 user nova-compute[71507]:     <vmcoreinfo/>
Apr 13 15:44:11 user nova-compute[71507]:   </features>
Apr 13 15:44:11 user nova-compute[71507]:   <clock offset="utc">
Apr 13 15:44:11 user nova-compute[71507]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 15:44:11 user nova-compute[71507]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 15:44:11 user nova-compute[71507]:     <timer name="hpet" present="no"/>
Apr 13 15:44:11 user nova-compute[71507]:   </clock>
Apr 13 15:44:11 user nova-compute[71507]:   <cpu mode="custom" match="exact">
Apr 13 15:44:11 user nova-compute[71507]:     <model>Nehalem</model>
Apr 13 15:44:11 user nova-compute[71507]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 15:44:11 user nova-compute[71507]:   </cpu>
Apr 13 15:44:11 user nova-compute[71507]:   <devices>
Apr 13 15:44:11 user nova-compute[71507]:     <disk type="block" device="disk">
Apr 13 15:44:11 user nova-compute[71507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 15:44:11 user nova-compute[71507]:       <source dev="/dev/sdc"/>
Apr 13 15:44:11 user nova-compute[71507]:       <target dev="vda" bus="virtio"/>
Apr 13 15:44:11 user nova-compute[71507]:       <serial>29098607-080d-4a0e-afda-65df97acdffe</serial>
Apr 13 15:44:11 user nova-compute[71507]:     </disk>
Apr 13 15:44:11 user nova-compute[71507]:     <interface type="ethernet">
Apr 13 15:44:11 user nova-compute[71507]:       <mac address="fa:16:3e:a5:7a:3d"/>
Apr 13 15:44:11 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:44:11 user nova-compute[71507]:       <mtu size="1442"/>
Apr 13 15:44:11 user nova-compute[71507]:       <target dev="tapa1c8b5ae-b8"/>
Apr 13 15:44:11 user nova-compute[71507]:     </interface>
Apr 13 15:44:11 user nova-compute[71507]:     <serial type="pty">
Apr 13 15:44:11 user nova-compute[71507]:       <log file="/opt/stack/data/nova/instances/b2745a5e-fef2-47ac-983d-dfd197fdf8c4/console.log" append="off"/>
Apr 13 15:44:11 user nova-compute[71507]:     </serial>
Apr 13 15:44:11 user nova-compute[71507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 15:44:11 user nova-compute[71507]:     <video>
Apr 13 15:44:11 user nova-compute[71507]:       <model type="virtio"/>
Apr 13 15:44:11 user nova-compute[71507]:     </video>
Apr 13 15:44:11 user nova-compute[71507]:     <rng model="virtio">
Apr 13 15:44:11 user nova-compute[71507]:       <backend model="random">/dev/urandom</backend>
Apr 13 15:44:11 user nova-compute[71507]:     </rng>
Apr 13 15:44:11 user nova-compute[71507]:     <controller type="usb" index="0" model="none"/>
Apr 13 15:44:11 user nova-compute[71507]:     <memballoon model="virtio">
Apr 13 15:44:11 user nova-compute[71507]:       <stats period="10"/>
Apr 13 15:44:11 user nova-compute[71507]:     </memballoon>
Apr 13 15:44:11 user nova-compute[71507]:   </devices>
Apr 13 15:44:11 user nova-compute[71507]: </domain>
Apr 13 15:44:11 user nova-compute[71507]:  {{(pid=71507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1669921011',display_name='tempest-TestVolumeBootPattern-server-1669921011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1669921011',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA==',key_name='tempest-TestVolumeBootPattern-534201410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-i27m19cb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T15:44:05Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=b2745a5e-fef2-47ac-983d-dfd197fdf8c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:7a:3d,bridge_name='br-int',has_traffic_filtering=True,id=a1c8b5ae-b836-48d3-b13f-5a13cfa72876,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c8b5ae-b8') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG os_vif [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:7a:3d,bridge_name='br-int',has_traffic_filtering=True,id=a1c8b5ae-b836-48d3-b13f-5a13cfa72876,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c8b5ae-b8') {{(pid=71507) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1c8b5ae-b8, may_exist=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1c8b5ae-b8, col_values=(('external_ids', {'iface-id': 'a1c8b5ae-b836-48d3-b13f-5a13cfa72876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:7a:3d', 'vm-uuid': 'b2745a5e-fef2-47ac-983d-dfd197fdf8c4'}),)) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:11 user nova-compute[71507]: INFO os_vif [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:7a:3d,bridge_name='br-int',has_traffic_filtering=True,id=a1c8b5ae-b836-48d3-b13f-5a13cfa72876,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c8b5ae-b8')
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No BDM found with device name vda, not building metadata. {{(pid=71507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 15:44:11 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] No VIF found with MAC fa:16:3e:a5:7a:3d, not building metadata {{(pid=71507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 15:44:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received event network-vif-plugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:44:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] Acquiring lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:44:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:44:12 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:44:12 user nova-compute[71507]: DEBUG nova.compute.manager [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] No waiting events found dispatching network-vif-plugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:44:12 user nova-compute[71507]: WARNING nova.compute.manager [req-dd5ab840-d669-4ddf-89d4-bdcb73628d73 req-75a7e041-495f-4f44-b5c6-c5b43fd444b9 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received unexpected event network-vif-plugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance with vm_state building and task_state spawning.
Apr 13 15:44:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:12 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400654.6879513, b2745a5e-fef2-47ac-983d-dfd197fdf8c4 => Resumed> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:44:14 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] VM Resumed (Lifecycle Event)
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Instance event wait completed in 0 seconds for  {{(pid=71507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Guest created on hypervisor {{(pid=71507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 15:44:14 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Instance spawned successfully.
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Found default for hw_cdrom_bus of ide {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Found default for hw_disk_bus of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Found default for hw_input_bus of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Found default for hw_pointer_model of None {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Found default for hw_video_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Found default for hw_vif_model of virtio {{(pid=71507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 15:44:14 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.virt.driver [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] Emitting event <LifecycleEvent: 1681400654.6916, b2745a5e-fef2-47ac-983d-dfd197fdf8c4 => Started> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:44:14 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] VM Started (Lifecycle Event)
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71507) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 15:44:14 user nova-compute[71507]: INFO nova.compute.manager [None req-49b19af8-a3d0-4208-bc24-1eb2893a1531 None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 15:44:14 user nova-compute[71507]: INFO nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Took 4.92 seconds to spawn the instance on the hypervisor.
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received event network-vif-plugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] Acquiring lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:44:14 user nova-compute[71507]: DEBUG nova.compute.manager [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] No waiting events found dispatching network-vif-plugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:44:14 user nova-compute[71507]: WARNING nova.compute.manager [req-8c2b1e22-312e-4265-ad3e-e2711507db07 req-46169b0a-ac00-481e-9b9a-976d3e65d223 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received unexpected event network-vif-plugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance with vm_state building and task_state spawning.
Apr 13 15:44:14 user nova-compute[71507]: INFO nova.compute.manager [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Took 9.98 seconds to build instance.
Apr 13 15:44:14 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-7d5095ff-576d-4db5-a8d7-1004857eaad1 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.092s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:44:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:24 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_power_states {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid 53fa5a01-9d0a-480b-b1d3-028930c0e560 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:44:24 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Triggering sync for uuid b2745a5e-fef2-47ac-983d-dfd197fdf8c4 {{(pid=71507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 15:44:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "53fa5a01-9d0a-480b-b1d3-028930c0e560" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:44:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:44:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:44:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:44:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:44:24 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:44:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:44:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:44:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:44:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:44:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:35 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:39 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:44:39 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:44:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:44:39 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:44:39 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:44:39 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid 53fa5a01-9d0a-480b-b1d3-028930c0e560 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:44:40 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updating instance_info_cache with network_info: [{"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:44:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:44:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:44:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:44:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:44:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:44:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:44:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:44:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:44:48 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:44:48 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:44:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=26.056381225585938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:44:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:44:50 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:44:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:44:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:44:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:44:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:44:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:54 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:54 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:44:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:44:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:44:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:44:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:44:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:57 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:44:59 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:44:59 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:45:01 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:06 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:45:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:45:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:45:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:11 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:45:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:45:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:16 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:21 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:45:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:45:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:45:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:26 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:45:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:45:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:31 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:36 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:40 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:45:40 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:45:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:45:40 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:45:40 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:45:41 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updating instance_info_cache with network_info: [{"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:45:41 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:45:41 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:45:41 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:45:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:45:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:45:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:45:46 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:47 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:45:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:45:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:45:47 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:45:47 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:45:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:45:47 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:45:48 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:45:48 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:45:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=26.055801391601562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:45:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:45:50 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:45:51 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:45:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:45:55 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:56 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:56 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:45:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:45:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received event network-changed-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:45:56 user nova-compute[71507]: DEBUG nova.compute.manager [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Refreshing instance network info cache due to event network-changed-a1c8b5ae-b836-48d3-b13f-5a13cfa72876. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:45:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] Acquiring lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:45:56 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] Acquired lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:45:56 user nova-compute[71507]: DEBUG nova.network.neutron [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Refreshing network info cache for port a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:45:57 user nova-compute[71507]: INFO nova.compute.manager [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Terminating instance
Apr 13 15:45:57 user nova-compute[71507]: DEBUG nova.compute.manager [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG nova.network.neutron [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updated VIF entry in instance network info cache for port a1c8b5ae-b836-48d3-b13f-5a13cfa72876. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG nova.network.neutron [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updating instance_info_cache with network_info: [{"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-f0aa390c-f636-47b3-8bf9-8aae69052f4d req-d854b017-0086-49cb-aa90-9291db128fc3 service nova] Releasing lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received event network-vif-unplugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] Acquiring lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] No waiting events found dispatching network-vif-unplugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG nova.compute.manager [req-5f9f1d45-45ed-4544-b845-219d690b63b6 req-c74c28cd-fec4-4f2e-801e-fb4b030f0fe7 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received event network-vif-unplugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:57 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:57 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Instance destroyed successfully.
Apr 13 15:45:57 user nova-compute[71507]: DEBUG nova.objects.instance [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'resources' on Instance uuid b2745a5e-fef2-47ac-983d-dfd197fdf8c4 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1669921011',display_name='tempest-TestVolumeBootPattern-server-1669921011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1669921011',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA==',key_name='tempest-TestVolumeBootPattern-534201410',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:44:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-i27m19cb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:44:15Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=b2745a5e-fef2-47ac-983d-dfd197fdf8c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "address": "fa:16:3e:a5:7a:3d", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c8b5ae-b8", "ovs_interfaceid": "a1c8b5ae-b836-48d3-b13f-5a13cfa72876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:7a:3d,bridge_name='br-int',has_traffic_filtering=True,id=a1c8b5ae-b836-48d3-b13f-5a13cfa72876,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c8b5ae-b8') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_vif [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:7a:3d,bridge_name='br-int',has_traffic_filtering=True,id=a1c8b5ae-b836-48d3-b13f-5a13cfa72876,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c8b5ae-b8') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1c8b5ae-b8, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:45:58 user nova-compute[71507]: INFO os_vif [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:7a:3d,bridge_name='br-int',has_traffic_filtering=True,id=a1c8b5ae-b836-48d3-b13f-5a13cfa72876,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c8b5ae-b8')
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjzYrTUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:45:58 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5b1939-672b-48a6-b7bd-20c33c34ac39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:45:58 user nova-compute[71507]: No targets found.
Apr 13 15:45:58 user nova-compute[71507]: iSNS:
Apr 13 15:45:58 user nova-compute[71507]: No targets found.
Apr 13 15:45:58 user nova-compute[71507]: STATIC:
Apr 13 15:45:58 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe
Apr 13 15:45:58 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:45:58 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:45:58 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8
Apr 13 15:45:58 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:45:58 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:45:58 user nova-compute[71507]: FIRMWARE:
Apr 13 15:45:58 user nova-compute[71507]: No targets found.
Apr 13 15:45:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:45:58 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:45:58 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7578f9a8-6d43-437d-abde-3161686a8390]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5633e997-0030-4517-848d-89c01851b5f1]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:45:58 user nova-compute[71507]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe (non-flash)
Apr 13 15:45:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:45:58 user nova-compute[71507]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe (non-flash)
Apr 13 15:45:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c391cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe'): ({'sdc'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Removing single pathed devices sdc {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc63532-9e8d-4013-8c72-474b7adb6f3b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b096cd3-1038-4b37-b9ea-1b01fa7e77bc]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flushing IO for device /dev/sdc {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de8b559-3fe6-4511-8b7b-8861534e390d]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f42df-5a4f-4f2f-981e-2ebda0ac2e05]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] SCSI volumes sdc have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d706aa-338b-457f-b531-cc927f193daf]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33db6d4-7f60-46a7-a3e0-f85b6d4c386c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe, portal: 172.16.0.220,3260]
Apr 13 15:45:58 user nova-compute[71507]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe, portal: 172.16.0.220,3260] successful.
Apr 13 15:45:58 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29098607-080d-4a0e-afda-65df97acdffe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a71ee6c-7a4c-4143-b63e-bb3eda8fd329]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== disconnect_volume: return (294ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:45:58 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Deleting instance files /opt/stack/data/nova/instances/b2745a5e-fef2-47ac-983d-dfd197fdf8c4_del
Apr 13 15:45:58 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Deletion of /opt/stack/data/nova/instances/b2745a5e-fef2-47ac-983d-dfd197fdf8c4_del complete
Apr 13 15:45:58 user nova-compute[71507]: INFO nova.compute.manager [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received event network-changed-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.compute.manager [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Refreshing instance network info cache due to event network-changed-a1c8b5ae-b836-48d3-b13f-5a13cfa72876. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] Acquiring lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] Acquired lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.network.neutron [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Refreshing network info cache for port a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:45:58 user nova-compute[71507]: INFO nova.network.neutron [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Port a1c8b5ae-b836-48d3-b13f-5a13cfa72876 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.network.neutron [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:45:58 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-ad6314c0-7be5-4171-8778-95489be6a17f req-59f5f20a-bff7-4a57-b062-0b203aeac6f5 service nova] Releasing lock "refresh_cache-b2745a5e-fef2-47ac-983d-dfd197fdf8c4" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:45:58 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Took 0.45 seconds to deallocate network for instance.
Apr 13 15:45:59 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:45:59 user nova-compute[71507]: DEBUG nova.compute.manager [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received event network-vif-plugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:45:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] Acquiring lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:45:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:45:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:45:59 user nova-compute[71507]: DEBUG nova.compute.manager [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] No waiting events found dispatching network-vif-plugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:45:59 user nova-compute[71507]: WARNING nova.compute.manager [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received unexpected event network-vif-plugged-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 for instance with vm_state active and task_state deleting.
Apr 13 15:45:59 user nova-compute[71507]: DEBUG nova.compute.manager [req-e5771e1e-4177-413e-9197-c911b1a88262 req-23a38f9d-012a-4227-bc86-de13b2473db4 service nova] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Received event network-vif-deleted-a1c8b5ae-b836-48d3-b13f-5a13cfa72876 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:45:59 user nova-compute[71507]: INFO nova.compute.manager [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Took 0.81 seconds to detach 1 volumes for instance.
Apr 13 15:45:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:45:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:45:59 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:45:59 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:45:59 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:45:59 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Deleted allocations for instance b2745a5e-fef2-47ac-983d-dfd197fdf8c4
Apr 13 15:46:00 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-4c0c700a-933d-4001-b75f-1b3e949a263a tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "b2745a5e-fef2-47ac-983d-dfd197fdf8c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:46:01 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:46:01 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:46:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:46:10 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:46:12 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400757.993439, b2745a5e-fef2-47ac-983d-dfd197fdf8c4 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:46:12 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] VM Stopped (Lifecycle Event)
Apr 13 15:46:13 user nova-compute[71507]: DEBUG nova.compute.manager [None req-56508578-67d3-4fa1-a595-ef7d7f7b0310 None None] [instance: b2745a5e-fef2-47ac-983d-dfd197fdf8c4] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:46:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:46:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:46:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:46:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:46:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:46:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:46:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:46:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:46:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:46:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:46:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:46:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:46:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:46:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:46:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:46:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:46:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:46:42 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquired lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:46:42 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Forcefully refreshing network info cache for instance {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 15:46:42 user nova-compute[71507]: DEBUG nova.objects.instance [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lazy-loading 'info_cache' on Instance uuid 53fa5a01-9d0a-480b-b1d3-028930c0e560 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:46:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:43 user nova-compute[71507]: DEBUG nova.network.neutron [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updating instance_info_cache with network_info: [{"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:46:43 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Releasing lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:46:43 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updated the network info_cache for instance {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 15:46:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:48 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:46:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:46:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:46:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:46:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:46:48 user nova-compute[71507]: DEBUG nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 15:46:49 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:46:49 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:46:49 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=26.05484390258789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:46:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:46:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:46:49 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Instance 53fa5a01-9d0a-480b-b1d3-028930c0e560 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 15:46:49 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:46:49 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:46:49 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:46:49 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:46:49 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:46:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:46:51 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received event network-changed-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG nova.compute.manager [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Refreshing instance network info cache due to event network-changed-9fd4d123-8854-4643-8716-914a4c5694e3. {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] Acquiring lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] Acquired lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG nova.network.neutron [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Refreshing network info cache for port 9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "53fa5a01-9d0a-480b-b1d3-028930c0e560" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:46:52 user nova-compute[71507]: INFO nova.compute.manager [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Terminating instance
Apr 13 15:46:52 user nova-compute[71507]: DEBUG nova.compute.manager [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Start destroying the instance on the hypervisor. {{(pid=71507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received event network-vif-unplugged-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] Acquiring lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] No waiting events found dispatching network-vif-unplugged-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.compute.manager [req-09017cd2-8a30-4c63-8fcd-1f9194edc845 req-b56bb29e-e67d-4977-bb6f-edd77c71710c service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received event network-vif-unplugged-9fd4d123-8854-4643-8716-914a4c5694e3 for instance with task_state deleting. {{(pid=71507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:53 user nova-compute[71507]: INFO nova.virt.libvirt.driver [-] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Instance destroyed successfully.
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.objects.instance [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lazy-loading 'resources' on Instance uuid 53fa5a01-9d0a-480b-b1d3-028930c0e560 {{(pid=71507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.vif [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T15:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109801531',display_name='tempest-TestVolumeBootPattern-server-109801531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-109801531',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvwV+aAKfg33qNc4wbr/2paTGAcc8SWvEWZnoIyM328VKubs+duvBPWYWegdOxTNyVK1CI/xe2k8VnkjZf7A2j1zik7CJLh6S5ckj/+pwbRpfx8pIYG6hJrUBOjoI8yqA==',key_name='tempest-TestVolumeBootPattern-534201410',keypairs=<?>,launch_index=0,launched_at=2023-04-13T15:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d7f771264c4cd2bc595a2c525082d0',ramdisk_id='',reservation_id='r-f6y6xkcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-374778702',owner_user_name='tempest-TestVolumeBootPattern-374778702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T15:42:18Z,user_data=None,user_id='0307fb8d127a41079e34355904352231',uuid=53fa5a01-9d0a-480b-b1d3-028930c0e560,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converting VIF {"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.network.os_vif_util [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:fb:74,bridge_name='br-int',has_traffic_filtering=True,id=9fd4d123-8854-4643-8716-914a4c5694e3,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd4d123-88') {{(pid=71507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_vif [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:fb:74,bridge_name='br-int',has_traffic_filtering=True,id=9fd4d123-8854-4643-8716-914a4c5694e3,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd4d123-88') {{(pid=71507) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fd4d123-88, bridge=br-int, if_exists=True) {{(pid=71507) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:46:53 user nova-compute[71507]: INFO os_vif [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:fb:74,bridge_name='br-int',has_traffic_filtering=True,id=9fd4d123-8854-4643-8716-914a4c5694e3,network=Network(66ea8c1a-1c77-4a2a-ab35-64acac4762c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd4d123-88')
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] calling os-brick to detach iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fab1c1f0e50>, {'target_iqn': 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtFEQnMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 15:46:53 user nova-compute[71507]: WARNING os_brick.initiator.connectors.base [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d8e256-6855-4324-bf9b-c2653a1a5581]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 15:46:53 user nova-compute[71507]: No targets found.
Apr 13 15:46:53 user nova-compute[71507]: iSNS:
Apr 13 15:46:53 user nova-compute[71507]: No targets found.
Apr 13 15:46:53 user nova-compute[71507]: STATIC:
Apr 13 15:46:53 user nova-compute[71507]: Target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8
Apr 13 15:46:53 user nova-compute[71507]:         Portal: 172.16.0.220:3260,-1
Apr 13 15:46:53 user nova-compute[71507]:                 Iface Name: default
Apr 13 15:46:53 user nova-compute[71507]: FIRMWARE:
Apr 13 15:46:53 user nova-compute[71507]: No targets found.
Apr 13 15:46:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 15:46:53 user nova-compute[71507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 15:46:53 user nova-compute[71507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71507) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8', 0)] {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updated VIF entry in instance network info cache for port 9fd4d123-8854-4643-8716-914a4c5694e3. {{(pid=71507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.network.neutron [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updating instance_info_cache with network_info: [{"id": "9fd4d123-8854-4643-8716-914a4c5694e3", "address": "fa:16:3e:69:fb:74", "network": {"id": "66ea8c1a-1c77-4a2a-ab35-64acac4762c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-443328987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d7f771264c4cd2bc595a2c525082d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd4d123-88", "ovs_interfaceid": "9fd4d123-8854-4643-8716-914a4c5694e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f26b6cf-946a-43f1-b39e-522acc7c2811]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-665c6350-a504-4527-a380-1476a0e1183a req-84e760f2-8d97-4a6d-848a-5b75606b3ee9 service nova] Releasing lock "refresh_cache-53fa5a01-9d0a-480b-b1d3-028930c0e560" {{(pid=71507) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e53b6d-4f02-4015-bf3c-823047b0dfb4]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:46:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 (non-flash)
Apr 13 15:46:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fab1c660dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8'): ({'sdb'}, set())}) {{(pid=71507) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Removing single pathed devices sdb {{(pid=71507) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6885adbd-c497-4c1d-87b6-0901bfd241d9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce183c25-ebfe-4e05-8c1e-4e6c00bec8f5]: (4, ('ok\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Flushing IO for device /dev/sdb {{(pid=71507) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[399229e5-0cf5-4e12-bb96-6b63e7cd5121]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71507) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfec7dc-2c73-467d-809f-319facf9a9c7]: (4, ('1', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.linuxscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] SCSI volumes sdb have been removed. {{(pid=71507) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4273a0ed', '/dev/disk/by-id/scsi-23537363631666363', '/dev/disk/by-id/scsi-1SCST_BIO4273a0ed-57661fcc3d389b3e') {{(pid=81901) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b1d5b-fe77-4484-9bb3-aec5a6f203b6]: (4, None) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8')] {{(pid=71507) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d4c0e4-44fb-4d67-a1f8-bcfc017eab75]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --logout {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35daa13-6188-4e14-bc49-8a7b5265f801]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260]
Apr 13 15:46:53 user nova-compute[71507]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8, portal: 172.16.0.220,3260] successful.
Apr 13 15:46:53 user nova-compute[71507]:  stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op delete {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9e3ad7-579a-414a-8143-d36ef6b41bf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81901) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f0db9-7e90-4469-9f1c-01267edc8c38]: (4, ('', '')) {{(pid=81901) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71507) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.base [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] <== disconnect_volume: return (281ms) None {{(pid=71507) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Disconnected iSCSI Volume {{(pid=71507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 15:46:53 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Deleting instance files /opt/stack/data/nova/instances/53fa5a01-9d0a-480b-b1d3-028930c0e560_del
Apr 13 15:46:53 user nova-compute[71507]: INFO nova.virt.libvirt.driver [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Deletion of /opt/stack/data/nova/instances/53fa5a01-9d0a-480b-b1d3-028930c0e560_del complete
Apr 13 15:46:53 user nova-compute[71507]: INFO nova.compute.manager [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 13 15:46:53 user nova-compute[71507]: DEBUG oslo.service.loopingcall [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71507) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.compute.manager [-] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Deallocating network for instance {{(pid=71507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 15:46:53 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] deallocate_for_instance() {{(pid=71507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 15:46:54 user nova-compute[71507]: DEBUG nova.network.neutron [-] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Updating instance_info_cache with network_info: [] {{(pid=71507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 15:46:54 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Took 0.48 seconds to deallocate network for instance.
Apr 13 15:46:55 user nova-compute[71507]: INFO nova.compute.manager [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Took 0.75 seconds to detach 1 volumes for instance.
Apr 13 15:46:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:46:55 user nova-compute[71507]: INFO nova.scheduler.client.report [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Deleted allocations for instance 53fa5a01-9d0a-480b-b1d3-028930c0e560
Apr 13 15:46:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received event network-vif-plugged-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] Acquiring lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] No waiting events found dispatching network-vif-plugged-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 15:46:55 user nova-compute[71507]: WARNING nova.compute.manager [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received unexpected event network-vif-plugged-9fd4d123-8854-4643-8716-914a4c5694e3 for instance with vm_state deleted and task_state None.
Apr 13 15:46:55 user nova-compute[71507]: DEBUG nova.compute.manager [req-0421b02b-9a12-4976-8b64-9a54da4ff839 req-6446bf39-b29c-4440-aa92-4cbe2e51a387 service nova] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Received event network-vif-deleted-9fd4d123-8854-4643-8716-914a4c5694e3 {{(pid=71507) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-21e8914e-870b-4530-a288-e7ac87e75100 tempest-TestVolumeBootPattern-374778702 tempest-TestVolumeBootPattern-374778702-project-member] Lock "53fa5a01-9d0a-480b-b1d3-028930c0e560" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.732s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:46:55 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:46:56 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:46:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:46:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:00 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:47:01 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:47:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:47:03 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:47:08 user nova-compute[71507]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681400813.5014763, 53fa5a01-9d0a-480b-b1d3-028930c0e560 => Stopped> {{(pid=71507) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 15:47:08 user nova-compute[71507]: INFO nova.compute.manager [-] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] VM Stopped (Lifecycle Event)
Apr 13 15:47:08 user nova-compute[71507]: DEBUG nova.compute.manager [None req-32247cc0-20eb-4684-abef-e69d3df47cf5 None None] [instance: 53fa5a01-9d0a-480b-b1d3-028930c0e560] Checking state {{(pid=71507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 15:47:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:47:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:47:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:47:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:47:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:47:18 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:23 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:47:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:47:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:47:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:47:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:47:28 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:33 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:38 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:47:42 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:47:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Starting heal instance info cache {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 15:47:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Rebuilding the list of instances to heal {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 15:47:42 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Didn't find any instances for network info cache update. {{(pid=71507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 15:47:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:47:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:47:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:47:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:47:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:43 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:48 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager.update_available_resource {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:47:48 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:47:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:47:48 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:47:48 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Auditing locally available compute resources for user (node: user) {{(pid=71507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 15:47:49 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:47:49 user nova-compute[71507]: WARNING nova.virt.libvirt.driver [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 15:47:49 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Hypervisor/Node resource view: name=user free_ram=8865MB free_disk=26.045806884765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 15:47:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 15:47:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 15:47:49 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 15:47:49 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 15:47:49 user nova-compute[71507]: DEBUG nova.compute.provider_tree [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed in ProviderTree for provider: d4bde90d-fb36-4cb3-9849-976dd28e1f71 {{(pid=71507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 15:47:49 user nova-compute[71507]: DEBUG nova.scheduler.client.report [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Inventory has not changed for provider d4bde90d-fb36-4cb3-9849-976dd28e1f71 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 15:47:49 user nova-compute[71507]: DEBUG nova.compute.resource_tracker [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Compute_service record updated for user:user {{(pid=71507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 15:47:49 user nova-compute[71507]: DEBUG oslo_concurrency.lockutils [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=71507) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 15:47:50 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:52 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:53 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:47:53 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:47:56 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:47:56 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:47:56 user nova-compute[71507]: DEBUG nova.compute.manager [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 15:47:57 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:47:58 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:48:00 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:48:03 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:48:03 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 15:48:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:48:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:48:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:48:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:48:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:48:03 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:48:08 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:48:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 15:48:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:48:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=71507) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 15:48:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:48:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71507) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 15:48:13 user nova-compute[71507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71507) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 15:48:15 user nova-compute[71507]: DEBUG oslo_service.periodic_task [None req-04991eb7-175c-4569-ba59-408aa72b5fcb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71507) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}